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ABSTRACT 

This docunent describes in detail a study of 
postdoctoral training in bionedical sciences. Highlights of the study 
indicate: (1) During the 1958-70 period, 8,685 postdoctorals, egually 
divided between HD"s and PD's, were supported by the National 
Institute of General Hedical Sciences (NIGHS) , at a total cost of 
$86.5 Billion. (2) Directors of the nation's leading bionedical 
research laboratories, the postdoctorals now in training there, and 
forver NIGHS postdoctorals, presented strong testiuony to the effect 
that training at this level is essential to the continued iDproweaent 
of sedical science and the delivery of advanced techniques for the 
diagnosis, care, and treatment of disease. (3) The study indicates 
that the objectives of the postdoctoral research training have been 
met by those supported by the following data: (a) Both post-H.D.'s 
and post-Ph.D.'s are found on followup to be employed by the nation's 
medical schools in numbers far beyond those of H.D.'s and Ph.D.'s 
without training, and having advanced faster up the academic ladder 
than have comparable groups without postdoctoral training, (b) 
Post-H.D.'s and post-Ph.D.'s are much more frequently employed by the 
more research-oriented medical schools than by those less 
research-oriented and in much greater proportions than are Ph.D.'s 
and H.D.'s without postdoctoral training. Additional findings are 
included. (HJH) 
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NOTICE 



The project which Is the subject of this report waA approved by the 
Governing Board of the National Research Council* acting in behalf of the 
National Academy of Sciences. Such approval reflects the Board's judgment 
that the project Is of national importance and appropriate with respect to 
both the purpo&es and resources of the National Research Council. 

The members of the committee selected to undertake this project and 
prepare this report were chosen for recognised scholarly competence and 
with due consideration for the balance of disciplines appropriate to the 
project. Responsibility for the detailed asp-cts of this report rests 
with that committee. 

Each report issuing from a study committee of the National Research 
Council is reviewed by an independent group of qualified individuals 
according to procedures established and monitored by the Report Review 
Committee of the National Academy of Sciences. Distribution of the report 
is approved, by the President of the Academy, upon satisfactory completion 
of the review process. 
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HIGHLIGHTS 



During the 1958-1970 period, 8,685 postdoctorals, equally divided be- 
tween MD's and PhD's, were supported by the> NIGMS, at a total cost of 
$86.5 million. The purpose of the study reported here was a review 
and evaluation of the career impacts of this program of postdoctoral 
support. 

Directors of the nation's leading biomedical research laboratories, 
the postdoctorals now in training there, and former NIGMS postdoctorals, 
presented strong testimony to the effect that training at this level is 
essential to the continued! improvement of mt- ijt-l science and the dell- 
very of advanced techniques for the diagnosis, ore, and treatment of 
disease. 

The study indicates that the objectives of th.. postdoctoral research 
training - to increase both the number and competence of biomedical 
researchers - have been met by those supported, as shown by the following 
data: 

Both post-MD's and post-PhD's are found on follow-up to be employed by 
the nation's medica] schools in numbers far beyond those of MD*s and PhD's 
witiiout such training, and have advanced faster up the academic ladder 
than have comparable groups without postdoctoral training. 

Post-MD's and post-PhD's are much more frequently employed by the more 
research-oriented medical schools than by those leas research-oriented, 
and in much greater proportion than are PhD's and MD's without postdoctoral 
training. 

A larger proportion of physicians who have postdoctoral training (as com- 
pared with those who do not have such training) publish articles in the 
scientific literature. Those postdoctorals who do publish, do so more 
frequently than do thoso without postdoctoral training, and are far more 
frequently cited by other scientists. This difference Increases as the 
stage of professional career advances. 



• Physicians with postdoctoral training win competitive research awards 
with a frequency several times that of physicians from the same graduation 
cohorts who do not have poAtdoctoral training. 

m PhD*8 with postdoctoral training are more frequently employed by academic 

InstitutlonSt particularly those with the most prestigious graduate schools* 
than are non<-postdoctoral PhD's, and are much more frequently engaged in 
research as a primary work activity. 

• PhD*s with postdoctoral training advance to the status of thesis adviser 
more rapidly and in larger numbers than do PhD*8 without poistdoctoral 
training. 

• PhD*s with postdoctoral training win competitive research grants much more 
frequently than do those without postdoctoral trainingt and the difference 
increases as careers mature. 

• Postdoctoral PhD's publish more and are cited far more in the scientific 
literature than are non-postdoctoral PhD*s» and these differences persist » 
with lowered intensity* when controls are Introduced for abilityt graduate 
school environment* place of employment « and major work activity. 
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PREFACE 



For over fifty years postdoctoral education has been a part of the 
higher education scene in the United States, but it is only in the past 
two decades that it has reached major proportions. Because this growth 
had gone almost unnoticed, the National Academy of Scitnces^ in 1966, 
undertook, with the sponsorship of several agencies and foundations, a 
major examination of the whole field cf postdoctoral education. The re- 
sults of that study. The Invisible University , published in 1969, made 
it clear that postdoctoral training has become an important, frequently 
essential experience for the younger scholar and an opportunity for re- 
invigoration and new directions for the established investigator. 

As the advance of science has increased the trend toward speciali- 
zation, and has added enormously to the body of knowledge and technical 
competence requiied for full qualification as an accomplished scholar, 
the importance of postdoctoral training has increased. Within these last 
two decades, postdoctoral study has reached institutional status and may 
justifiably be referred to as the newest stratum of higher education in 
this country. The importance of postdoctoral training has been most widely 
recognized in the biomedical sciences; it Is in this field that the largest 
proportion of PhD's undertake this level of training. For the physician 
who wishes to pursue a career in research or academic medicine, postdoctoral 
training has become almost a requirement. 

Concomitantly and equally significant, th -e highly motivated, highly 
trained young men and women serve as the junior colleagues of the more 
senior investigators to whom they are apprenticed. As such, they constitute 
a unique "labor force"; the coupling of their imagination, enthusiasm and 
energy with the experience of their mentore accounts: in considerable degree, 
for the enormous productivity of the American biomedical research endeavor. 



Philip Handler 
President 

National Academy of Sciences 
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FOREWORD 



In 1970 the National Institute of General Medical Sciences asked the 
National Research Council to undertake a study and evaluation of the pro- 
gram of postdoctoral fellowships and traineeshlps which the NIGMS had been 
sponsoring since 1958* In earlier study, the Council, through its 
Office of Scientific Personnel, had made a study of the effects of NIGMS 
training programs on predoctoral graduate education in the biomedical 
sciences. The new study was to include only the postdoctoral level (both 
post"^PhD and post«MD) and was to focus on the effects of postdoctoral train-^ 
ing on the careers of individuals, rather than on the effects of the train- 
ing on the graduate institutions. 

An Advisory Committee was chosen to guide the study and to evaluate 
the results. The members of the Comitcee were: 

Jerome W. Conn, University of Michigan 

John A. D. Cooper, Association of American Medical Colleges 

Richard B. Curtis, St. George Homes, Berkeley, California 

Warren 0» Hagstrom, University of Wisconsin 

Robert W* Hodge, University of California, Los Angeles 

Leon 0. Jacobson, University of Chicago (Chairman) 

Percy L. Julian, Juli^xn Research Institute 

Boris Magasanik, Massachusetts Institute of Technology 

The Committee held a nuid>er of meetings during the course of 1971, 1972, 
and 1973, planning the study, reviewing the data collected, and evaluating its 
significance. The conclusions of the Committee are presented in Chapter VIII, 
and it recommendations for the guidance of policy decisions in the field of 
higher education and advanced training are in Chapter IX. The collection and 
analysis of data for this study, and other staff support for the Committee w^re 
provided by the staff of the Office of Scientific Personnel* Interviews in 
biomedical laboratories were carried out by Dr. Richard B. Curtis. 

vi 
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NIGMS postdoctorals who wrote to the Committee regarding their experiences 
and opinions* 

This study was first submitted to NIGMS in July 1973. Following review 
by NIGMS» the report was published. 

It is the hope of the Committee that the findings of this study* which 
point unmistakably to the value of postdoctoral training for both bioscience 
PhD^s and fcr research-^oriented physicians* will be useful to all those con- 
cerned with biomedical education and the nation's health. 



December 1974 Leon 0. Jacobson* Chairman 
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CHAPTER I 



INTRODUCTION 



The National Institute of General Medical Sciences, one of the NIH 
Institutes, in 1970 requested the National Research Council to undertake 
a review of its program of postdoctoral training which had been begun iii 
1938. In addition to tracing the career patterns of the people who had been 
trained under this program, the NRC was requested to evaluate its effective*- 
ness In attaininnj; the program goals. These goals, very briefly stated, were 
(1) to enlarge and improve the pool of manpower available for biomedical re- 
search, and (2> to provide for advanced training of researchers in the 
nation's graduate schools and medical schools. The NRC undertook the 
task, and appointed an Advisory Committee on the Study of Postdoctoral 
Fellowship and Traineeship Programs in the Biomedical Sciences, whose 
members had been engaged in biomedical training and research or were 
experienced In the techniques of social science research* particularly in 
the area of advanced training. The first task of the Committee was to 
review the nature of the problem and to decide on a research strategy for 
accomplishing its mi&;sion. 

In orienting itself to its mission, the Committee first took note of 
the fact that the NIGMS postdoctoral training program did not develop in a 
vacuum, but in a milieu of many other training programs at the graduate and 
postdoctoral level, supported not only by other government agencies, but 
also by such private organizations as ^he American Cancer Society and the 
Jane Coffin Childs Foundation. The pl^ce of postdoctoral education. 
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furthermore, needed to be considered as it affected both biomedically-tralned PhD»a. 
and MD»8 who had taken up research or academic medicine. Another dimension added 
to the context in which this training has taken place la what may be very briefly 
suggested by the term "life sciences revolution." The life sciences have been 
transformed in many ways during the past two decades, through fundamental dis- 
coveries such as the nature of the DNA molecule and through the development of new 
and highly-refined techniques stemming from the physical sciences, such as electron 
microscopy, neutron activation analysis, and improved gas chromatography. At the 
level oi clinical application. fur.herr>orc. biomedical engineering has made rapid 
advances, with every indication that this work is still in its infancy. 

Postdoctoral education has been one of the most important ^eans tor meeting 
the challenges of this life science revolution, and larger numbers of bioscien- 
tists than scientists in other fields have undertaken postdoctoral training 
Yet postdoctoral training has not been limited to the life sciences. In the 
physical sciences, too. there has been manifest a need for further training be- 
yond that afforded by the graduate school, particularly for those intending to 
enter faculty positions in the better graduate schools. The need for such train- 
ing is not entirely new, the extent of its development, parallel with the vast 
expansion in doctorate output in the graduate schools, has been the stimulus to 
various studies of the extent and nature of postdoctoral education, and efforts 
to evaluate its impact, its costs, and its continuing importance in the field of 
higher education. Postdoctoral education in the biomedical sciences must there- 
fore be examined in the context of what has happened in postdoctoral education 
as a whole. 

«hat is postdoctoral eduction? Perhaps, as . starting point, the definition 
developed by an earlier colttee of the NAS^ will b. „oat use.al. The following 
definition of postdoctoral appointments .as used, and la quoted from Iho Invisible 
University ; ■ ■ 

"...appoint:nents of a temporary nature at the postdoctoral level 
that are intended to offer an opportunity for continued educatUn and 
experience m research, usually, though not necessarily, under the super- 
vision of a senior .cntor. The appointee may have a research doctorate 
(e.g.. P.hD. ScD) or professional doctorate (e.g.. md. DVM) or other quali- 
fications which are considered equivalent in the circumstances. A person 
may have more than one postdoctoral appointment during his career " 
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For over half a century postdoctoral training has had a recogniaed place 
in the American educational scene, but it is only in the pasil two decades 
that the number of postdoctorals has reached proportions that demand systematic 
study. The study undertaken in 1966 by the National Academy of Sciences,^ with 
the sponsorship of a number of public and private agencies indicated that there 
were, in the Jate 1960's. j.pproximately 16.000 "postdoctorals" studying in 
various United States universities, laboratories, and hospitals. Of these, it 
was estimated that approximately 1,200 were NIH Postdoctoral Fellows, and that 
another 500 were XIH Special Fellows. Undoubtedly there were many more supported 
by NIH under such titles as trainees, research associates, and a variety of 
other titles, working on a variety of research projects supported bv NIH grants. 

Despite the long history of postdoctoral education, largely dominated by 
and almost defined by the Rockefeller Foundation-supported National Research 
Fellowships during the 1920's. and emulated by other agencies in later years, 
the terra has lacked definition, and has grown to encompass a wide variety of 
situations. Most of the people termed "postdoctorals" are those who have 
recently completed PhD's, and who seek further research experience under an 
eminent mentor. Some are Mlj's. cither earlier graduates who seek an updating 
and enhancement of their clinical capabilities, or those who seek research 
training that was not provided by their medical school experience. For posi- 
tions In academic medicine, such training is becoming i^ver more important, if 
not essential. Other postdoctorals are people several or many years beyond 
the doctorate who seek to change their fields of specialization, to become 
acquainted with new techniques and research methods, or to refurbish research 
skills that may have become obsolescent. 

The settings in which postdoctoral training is undertaken, the titles 
given to people in such training, the sponsorship, and the kinds of work activity 
involved, are varied as the reasons for seeking such training and the back- 
grounds of those who undertake it. Yet throughout all the variations, the theme 
of increased competence in research, and the importance of studying under a 
highly skilled mentor, dominate the activity that goes under the title of post- 
doctoral education. It was recognition of the need for more highly skilled 
researchers in the bloraedicaJ sciences that led the National Institute of General 
Medical Sciences to undertake tiie support of postdoctoral education In 1938. and 
to continue it since. 

" Ibid. 
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In considering how to evaluate the postdoctoral traineeship and fellow* 
3 

ship programs of the NIGMS^ the Committee also faced the question of alterna-* 
tlves. What other means were there by which the objectives of the program 
might be achieved? Was it possible to estimate the effect of turning the re- 
sources which hitherto had been devoted to postdoctoral training, into other 
channels which conceivably might be more effective in attaining the same objec- 
tives? With this set of problems as a definition of its mission, the Committee 
considered how it might proceed to gather evidence that would be relevant to 
its evaluation, and how it might assess this evidence. 

One of the first issues was an operational definition of the program ob- 
jectives of the NIGMS postdoctoral program— a set of observable and measurable 
desired consequences of the program, against which the career outcomes and 
achievements of those who participated iii the program might be judged. Highly 
trained biomedical manpower is needed in many situations. One of these is the 
medical schools, which increasingly require a professoriate versed not only in 
clinical medicine, but also in research techniques, and familiar with the new 
and developing technologies which the medical profession is adopting and will 
Increasingly adopt over the predictable future. These teachers, needing both 
the clinical and research orientations, are most effective If they are trained 
together, so that they learn not only from their mentors, but from each other, 
acqnlrirg not only technical knowledge but mutual orientations and mutual 
respect. It was known that the medical schools hzA been increasingly requiring 
postdoctoral training for appointments to academic positions. Yet some ques- 
tions remained: Were people with such training advancing more rapidly up the 
academic ladder than people without postdoctoral training, and thus validating, 
through their performance, the method of their preparation? Were both post- 
MD*s and post-PhD*s being employed on medical school faculties? In what num- 
bers, and by which schools? All of these questions appeared to be answerable. 

A somewhat similar set of questions exists with respect to the post-PhO*s, 
but not an entirely similar one, because of the very different orientation with 
which the PhD approaches postdoctoral training, as compared with the MD. The 
former has already been trained in research technique; he may ne^d a great deal 
of improvement in precision, in breadth and depth, and even in orientation as 
to how research may best be done. Research is his primary orientation, however, 
as contrasted with the clinical orientation achieved in medical school, intern- 
ship, and residency, all of which normally precede postdoctoral research training 
for the MD. The post-PhD normally looks forward to a career of research or teaching 

3 

Trainees are locally appointed under terms of a training grant to the uni- 
versity. Fellows win appointments in a national competition; only a minority 
of candidates win appointments. 
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in a research-oriented environment. IncreaslnRly, thu better graduate schools 
have been requiring postdoctoral training for appointments to their faculties, 
just as have the medical schools. Have the NICMS postdoctoral s been winning the.«e 
appointments? At what schools? Have the numbers of people going along this career 
route from NIGMS postdoctoral training been consonant with the expenditures for 
such training? Have they won appointments in the Institutions which turn out PhD's, 
as compared with those awarding degrees at lower levels? Have they been appointed 
in due proportion in the most prestigious of thebe graduate schools? Have they 
made such progress In the academic environment as to validate the time, money, and 
effort spent on their postdoctoral training? 

in addition to tl.ose in the academic world, many PhD's, including many with 
postdoctoral training, are engaged In research in private industry, in governmental 
agencies, and In non-profit organizations. What proportion of these nonacademlc 
people are engaged primarily In research? How does this compare with the general 
run of those who have not had postdoctoral training? What evidence can be garnered 
with respect to the quality of their research? Are there measureable career 
achievement standards that make possible a comparison of the NIGMS post-PliD's 
with other postdoctorals, or with the people who have not had such training? 

A Three- Pronged Approach 

In con$$idering tlicsc various questions* and possible answers, the Cummittfe 
decided on a three-pronged approach. Although the Committee included within its 
membership people with extensive knowledge of the MCMS fellowship and trainee*^ 
ship programs and other comparable programs^ It was felt that it would be advisable 
to get the views of a variety of people outside the Committee. For outside views, 
two groups were to be queried. One consisted of the postdoctorals and mentors in 
lajcratories at the present time. To get their views, a member of the Committee 
would visit the laboratories and conduct interviews. The second group consisted 
of former holders of NICMS postdoctoral fellowships and tralneeshlps, who would 
be invited to send letters to the Coronitteet expressing their views, based on 
actual experience, as to the influence of the postdoctoral training on their lives 
and careers. They would also be invited to comment on possible alternatives for 
the funding of research and training. These two sets of data and opinions, it 
was felt, would help sharpen the questions which might be asked in concrete and 
quantifiable form and answered by reference to existing data banks. It was felt 
to be essential to have hard data which might be quantitatively analyzed to pro- 
vide fully objective judgments of the effects of postdoctoral training. This 
would be the third avenue of approach. 
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Organisation of the Report 

In accordance with this plan» the report Is organised to show (1) the 
evidence from the interviews; (2) the evidence from the letters received; 

(3) the Committee's further planning for the development of hard data; 

(4) statistical demographic data on the extent of postdoctoral training in 
general and of the NIGMS training in particular; and (S) the quantitative data 
regarding the subsequent careers of the NIGMS postdoctorals and of other groups 
without such training* Finally, the Committee sums up the evidence and draws 
its conclusions with respect to the program of NIGMS postdoctoral training* 

A technical appendix presents further detail on a number of techniques and data 
sets judged to be too voluminous for the body of the report. 
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SITE VISITS TO POSTDOCTORAL LABORATORIES 

In order to obtain a representative sample of the opinions of present mentors 
and of postdoctorals, it vas decided to visit a series of laboratories in the 
United States, on both coasts and in ipid-continent, including some of the most 
prestigious and sone of the lesser-known institutions. Arrangements were therefore 
made for visits to a total of eight laboratories hy a member of the Committee. 
Laboratory directors, other mentors, trainees, and fellows (both NIGMS and those 
of other programs) were interviewed. It was di.Kcovcred that, although the circum- 
stances of postdoctoral training varied widely, a rather consistent set of themes 
ran through the testimony of those involved with postdoctorr Is in laboratories 
large and small, famous and not so famous. These themes had to do with such topics 
as diffusion of knowledge and the opportunity to change direction from the frequently 
narrow focus of a PhD thesis, the broadening of outlook through contact with 
mentors, who were frequently outstanding people In their fields, the development 
of research skills beyond what had heen learned in previous training, and 
increased confidence in one's research capacity- important for teachers of 
graduate students in particular. 

Diffusion of Knowledge 

A subtle but persistent theme throughout the interviews in the postdoctoral 
laboratories relates to the diffusion of knowledge. Even with all the modern 
methods of communication, with books and journals, the most effective method 
of diffusing new knowledge and technique is through moving people. People are 
the carriers of the culture, whether technological or otherwise. Through con- 
tact with people who know different techniques or points of view, or even a 
different store of factual knowledge, the diffusion of research methods and 
results takes place in a way which is finally translated into practical results 
m medical care. This diffusion is regarded as one- of the most important 
results of the postdoctoral program, for it moves people from the institutions in 
Which they have learned one point of view or set of methodologies to another with 
a different outlook. Here the subtle but important interaction occurs: They 
learn and they teach, and the result, through a kind .>i "culturai chemistry" Is 
both the diffusion of knowledge and the creation of no. .'dc.i.s, new research 
approaches, and new science. 
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Broadening ol Outlook 

A major reason cited for postdoctoral training is a broadening of outlook^ 
the acquisition of a different way of approaching the scientific enterprise. 
This is true evwn for very able graduates of first-rate graduate departments. 
One such commented that he thinks he would have been wiser fo have gone elsewhere 
for his postdoctoral so that he could see other styles of research. He has 
arranged to go else%rfierc next year. Another said that overall he is happier 
than he expected to be and would change nothint; about his experience. It there 
had been no postdoctoral opportunities, his gi^owth would have been slow and his 
vision narrow. A mentor (although all his postdoctcrals assist in research) 
stressed that the postdoctoral period is important in developing a sense of 
independence. If there were no postdoctoral opportunities, most people would 
simply continue to develop., theic^octoral thesis. A fellow added that by changing 
Institutions one meets many people interested in what one is interested in, but 
from different backgrounds. He is glad that ho has moved around, since he has 
learned more than he could have at his FM) institution alone, although it is an 
outstanding one. 

A post-doctoral mentor in a laboratory with several NlGMS postdoctcrals 
stressed the importance of cxpetlencing other institutions to remove the paro- 
chial view one receives in graduate school. Expanding on this theme a bit, 
another postdoctoral in a famous laboratory Justified his taking a postdoctoral 
appointment on the grounds that it would take much longer to learn what he has 
learned if he had been on his own. Journals do not provide the details of tech- 
niques, and, even if one knows techniques, there is the question of when to apply 
them. He explained that he learned most of the techniques, their uses and how to 
approach a problem, as a graduate student. As a postdoctoral he has an oppor* 
tunlty to explore his own mind and to discover what he is capable oi doing. He 
also finds the clinical opportunities most valuable in his postdoctoral setting* 
Another had come to the same lc:h explicitly to work with a particular mentor. 
When he finished his Hil), hi: did not feel adequately prepared lo do research* 
His thesis topic was too narrow and he wanted to broaden himself. As a graduate 
student there was much emphasis on getting results and he didn't take chances. 
Here there were lots of experts around to ask. He luis picked up a different set 
of priorities and^ because of the good rapport in the laboratory, he feels more 
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free to ask for assistance. He is also able to pursue various avenues with 
respect to his problem without being tunneled into a preferred path by his 
research director; he has more independence. 

A mentor described by his colleagues as the most exciting researcher in 
biology in a famous laboratory described the postdoctoral period as the 
most vital part of the career of one who wants to do research. In doctoral work 
one tends to go straight down the line, but the postdoctoral time allows one to 
get t.'iing on an entirely different tack. It also brings the added maturity 
which allows one to do science in the right way, i.e., one works on solvable 
problems. Problems have a way of resisting solution until the time is ripe. 
The postdoctoral period teaches one how to recognise when things are right. In 
biology, particularly, most work is interdisciplinary. One must have the post- 
doctoral experience to pick up the other discipline. 

Change of Direction - for Individuals and for Science 

A change of discipline, or a developing of competence In new multidisciplinary 
or interdisciplinary fields, is another important aspect of the postdoctoral ex- 
perience. One postdoctoral at a prominent Institution said that his experience 
has been successful in all ways.. He enjoys collaborating and has had good inter- 
action with people in other disciplines. His education would have been very much 
more difficult without the postdoctoral appointment. He has learned how to ask 
questions and how to judge what will be Important five years from now. He is con- 
vinced that his fellow postdoctorals will be the researcr.-rs who will set the tone 
in his field of Immuno-pathology in the future. A leading mentor confided his own 
experience. Over the past ten years he has had a number of very gifted postdoctorals 
whose doctoral fields ranged from medicine to elementary parti. le physics. In 
his laboratory these scientists learned about mammalian cell biology. These 
ex-postdoctorals (over twenty in all) are still working in this field which 
started in the mentor's laboratory and they are spread over the United States and 
abroad. A whole field has been created via the postdoctoral route. Graduate 
students alone could not have done it, since the crucial aspect of the growth of 
the field is the knowledge and techniques the postdoctorals brought from other 
fields to apply to mammalian cell biology. These postdoctorals held all kinds 
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of fellowships from widely different sources. One postdoctoral received his PhD 
in organic chemistry, so his move to biochemistry represents a change of fields. 
His motivation was mainly to expand his employment opportunities. Compared to 
his pre-doctoral experience, the postdoctoral period is one of independence. He 
has chosen his problem after discussing it with his mentor and is able to pursue 
it as he sees fit. The director of a leading biomedical laboratory said the 
major function of postdoctoral work opportunities is for young people to work in 
new or newly formed areas of ::cience. This is the way science changes and grows. 
One must take already^ trained ^tiD*s and give them these opportunities. There 
are some areas of science i4iere the basic ideas are pretty well ^er. These do 
not need postdoctoral programs since the ideas are already in the undergraduate 
and graduate programs. Perhaps people in other fields who want to shift their 
careers, especially M.D.'s, should take postdoctorals in these established fields, 
but PhD's trained in such fields sliould not need the postdoctoral experience. 

Interaction of MD*s and FhD's 

The opportunity for M.D. 's and PhD's to be trained together during the 
postdoctoral period is widely regarded as one of the most valuable aspects of 
this experience. One M.D. mentor is involved in clinical Investigations and all 
of his people hold M.D, *s but have significant contact with the PhD's of other 
mentors. He never has many postdoctorals at any one time. In his peak year he 
had five postdoctorals, all from abroad. They now head laboratories in 
Israel, Toronto, Tubingen, Australia, and Japan. All who have come through his 
laboratory have stayed in research. Having himself come to biochemistry through 
the ^S> route, he acknowledges that his entire career as a scientist is based upon 
his postdoctoral experience. He was first exposed to biochemistry during his 
medical training, and, although he participated in some research during his 
medical experience, he sought and received a postdoctoral fellowship, where he 
learned both the field and the sense of research. He does not think that it is 
necessary for an M.D. to take a PhD subsequently. He even conjectured that 
the time lapse for the M.D. plus postdoctoral would be less than for the PhD plus 
postdoctoral. At any rate he did not regret at all the route that he took. 
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A postdoctoral at another leading Ub was an M.D. and has learned all the 
biochemistry he knows as a postdoctoral. He may still return to clinical medicine, 
but in an academic sot tins. He found an advantage in being an M.D. since he 
knew some of the problems from a clinical point of view. He would have changed 
his medical training but not his postdoctoral experience. Most of what he is 
learning is from his fellow postdoctorals. His mentor leaves him alone and he 
is forced to figure out the problem on his own. In a smaller institution, the 
director commented that his department is very rich in the variety of backgrounds 
of people who are associated with it. This is very useful for the predocLoral. 
The presence of MD'a is particularly enriching. 

Learning from Other Postdoctorals 

Tlif opportunity to If-arn from other postdoctorals was stressed by many of 
them. One of them said that he enjoys being around the other postdoctorals. 
A new needs people to compare himself to. If he could talk only to the 
laboratory director, hv would feel very inferior and Inadequate, but after 
talking with other postdoctorals he gets a better picture of himself at his stage 
of development. The postdoctorals also feed each other Intellectually. One 
stated tliat he ii.is IfarntJ nore from his fellow postdoctorals than from his 
professors. A third stated that he has obtained a different perspective on 
science, not only from hlfi mentor but also from his fellow postdoctorals. lie 
now feels re-enoouraged about science. The same thi-jnc was expretssed In negative 
form by a trainee in a laboratory with no other postdoctorals. He said he misses 
not having other postdoctorals around and feels very isolated. There had been 
a po8t-MD In the department a year ago and it had been pleasant working with 
him. Now he fecl« in a state of limbo. 

Increased Confidence for Teaching 

A great many postdoctorals are aiming at faculty positions in graduate 
schools. The postdoctoral experience is increasingly regarded as highly important 
training for this type of position, both from the individual and the institutional 
point of view. The postdoctorals themselves speak eloquently of their development 
of confidence in their teaching ability during the postdoctoral years. One 
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expressed the feeling that one comes out of graduate school feeling scmiewhat 
Insecure. If one Is treated as Just a pair of hands* then one's self-doubt 
begins to impair one's ability even to grind out data. It is self-defeating to 
use people as tools. Another postdoctoral suggested that the primary function 
of the postdoctoral period was to allow the postdoctoral to find out where things 
are and to be allowed to make mistakes. He spent Just under five years getting 
his doctorate — the first two years were spent in taking courses. His first 
three predoctoral years were very discouraging and left him feeling he was making 
no progress. Even when he received his FhD;^ he did not feel fully satisfied. 
He did not think that he could have been able to take on an independent position 
in a university; he lacked the self-*confidence. Anr c* coming to a prominent 
laboratory from a school without a national reputation, said that confidence 
building was his mentor's strongest suit. Being new and insecure, he didn't 
a£k questions at first, because h^ thought it was a sign of weakness. Now he 
has the confidence to expose his ignorance. 

At one of the laboratories visited, acquaintanceship with other scientists 
was almost impossible— in contrast to most of th^ where one is in contact with 
so many people. One postdoctoral here faults himuelf foi not pushing himself 
enough on other people. When he first arrived he was afraid to make a mistake 
in front of the lab director. He was even cautious in front of other post* 
doctorals. On the other hand he knew that he could never succeed as a scientist 
unless he could spend some time in a laboratory like this one. If he has any 
regrets about his postdoctoral experience, it is that there is not enough con- 
tact with students. 

Another postdoctoral in the same laboratory cited another benefit of the 
postdoctoral period: the opportunity to discover whether one can 'Wke it" in a 
top laboratory — both scientifically apd humanly. He learns not only science from 
his mentor, but also how to think about sicence. This latter is the most impor- 
tant thing he has learned; techniques can be learned from a book* the attitude 
only from a man. At another laboratory, a postdoctoral commented that another 
benefit of being a postdoctoral is that the graduate students are rotated among 
the postdoctorals every three months. They work directly for the postdoctoral 
and this gives the postdoctoral the experience of teaching, in a gradual way. 
The experience is like an apprenticeship to becoming a faculty member. A 
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laboratory director maintained that the postdoctoral experience is a sine qua 
aga for new faculty. The doctoral training is so intense and the demands of the 
faculty position are so grave that only a genius could go from the PhD to a 
faculty position. The PhD lacks experience. It is also hard to know from the 
doctoral dissertation alone whether the work t-^presents the student or his 
mentor. 

One of the few women postdoctorals interviewed said that she felt prepared to do 
research in the area of her dissertation when she completed her PhD. Her thesis 
research, however, was in a very narrow subject. Here she has had an opportunity 
to meet people, to exchange ideas and to learn new techniques. As a graduate 
student she felt stupid and found it difficult to ask questions. Here there are 
many people at the same level and her confidence has risen. She can take time 
to read outside her field now, but she still feels pressure. These are the 
critical years for a young scientist and one's future career depends upon what 
is produced during the postdoctoral period. She has produced research satis- 
factory to her and she thinks she has learned much. Because she wants to work 
at a university and guide graduate students m their research, she is aware that 
her own research must be in good order. 

Advantages to the Institution 

The postdoctoral-mentor relationship l, not by any means a one-way street. 
The postdoctorals bring Important values to the institution, also. In a smaller 
school, the department head said that postdoctorals have been terribly Important 
to his own research. They seem to come just when ho needs them to carry out 
something that has just opened up. They often providl a stimulus for going on 
with the research. They bring enthusiasm and challenge him to keep alive and 
not to get set m his ways. He provides them with Ideas and ways of thinking. 
It Is an Ideal teaching and symbiotic relationship. 

The postdoctoral program provides another Important service to the universities. 
In the opinion of the director at one of the large laboratories visited, it Is 
difficult to diagnose in science the man or woman who has only a modest amount of 
creativity at the doctoral level but whose growth will occur later, m the search 
for prospective faculty members the postdoctoral period allows the university to 
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see vdiether the candidate can do research before he Is hired. Without post** 
doctoral programs people would be hired and fired at a great rate and unhapplness 
would be created on a very high level. This department does not hire anyone at 
the assistant professor level who does not have a good chance to become a full 
professor. 

At a smaller school^ postdoctorals are Incorporated Into the teaching 
program. They work with the graduate students and help to train them. They 
are the heart of the department » Just as residents are In the clinical depart- 
ments. Graduate students spend time In research with several professors before 
picking one to be their dissertation supervisor. This gives the student several 
perspectives. Postdoctorals are treated In the same way. 

Quality and Quantity of Research 

At one of the larger schools , a mentor asserted that the quantity of research 
In the biological sciences la dependent upon the work of the postdoctorals. 
They do not have the other responsibilities v^lch are In a professor's life. 
Postdoctorals are also Important to bring new life to the department, since 
schools are not expandl.ig now. Without postdoctorals the department would tend 
to stagnate. One postdoctoral feels that he has taught his mentor more tech* 
nlques than he has learned from him* On the other hand» he has received a 
perspective on medical research from his mentor and an Idea of what Is likely 
to work. Another » at a leading laboratory » contended that most biological 
research Is done by postdoctorals. He believes further that postdoctorals are 
more Innovative than their mentors bec-i^Tse the; are younger and have more time. 
He Is aware that he will have more obligations ten years from now^ but believes 
his brain Is better now than It will be then, A laboratory director agreed that 
most high-quality research .Is being done by postdoctorals and suggested that the 
Justification of postdoctoral programs rests on the research that Is done. The post-* 
doctoral period Is the time when we get the best return for the money spent. At 
another laboratory the point was made that the postdoctorals serve research In 
part by helping to create critical sizes for the research groups. Unless a group 
reaches a critical size. It becomes Impossible to keep In touch with other work 
In the field. The group, by sharing the responsibility » can screen the enormous 
volume of publications. 
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Evaluations of the importance of the postdoctoral experience* either 
by the postdoctorals themselves or by their mentors, are expressed in differ- 
ent ways, often varying according to the particular ayle of the mentor or 
the way in which the relationships are structured within a given laboratory. 
One senior mentor, some of whose former postdoctorals are now themselves 
mentors of other postdoctorals, insisted that postdoctorals are absolutely 
essential to research in the United States— even more so than graduate 
students. Postdoctorals are the means of doing research and it Is obliga- 
tory that research money go to the support of postdoctorals. 



Flexibility Necessary for Efficiency 

Several mentors stressed the importance of a variety of modes of 
funding and flexibility In arrangements. In addition to competitive fellow- 
ships, one mentor said, reliable principal investigators should also have 
research funds from which they may support other postdoctorals. Such flexi- 
bility permits the principal investigator to staff his laboratory adequately. 
This mentor believes that research panels are concerned whether a principal 
Investigator has produced good students. They look Into the question of 
whether postdoctorals are given finite projects that they can anticipate 
finishing and whether the laboratory provides the appropriate environment 
for general and scientific growth. 

A student of the above mentor, now himself a postdoctoral mentor, says 
that he learned from this mentor his style for doing research and his ways 
of thinking about research. He aescribed him as having stored an enormous 
amount of Information and being able to come out with just that datum which 
fits the problem. Rather than methodically exhausting the alternatives, 
he uncannily picks the method that will work and then goes back and cleans 
up the details. The interviewee's predoctoral mentor was very different- 
very precise. He has tried to combine the two styles in his own research. 
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A dcnior researcher in one of the country's leading laboratories spoke 
of the relative Impact and differing results of different types of research 
support. He feels that eliminating postdoctoral fellowship or traineeship 
programs would shift the competition from the Junior level among prospective 
postdoctorals to the senior level where principal investigators would try to 
obtain sufficient research funds to support the postdoctorals as research 
associates. It is important to have the competition occur at the Junior level. 
A young man discovers how good he is and where he stands afm>ng his peers. The 
postdoctoral period operates to teach a man to work at the maximum of his capa- 
city. This is not necessarily true at the predoctoral level. There one must 
try to get the candidate through in a reasonable amount of time. The predoctoral 
student is like a patient. One cannot test him that deeply; he is not mature 
enough. Only in the postdoctoral period is a man free from major responsibilities 
and on his own. Also the pay is enough to live on. 

A mentor in a large public university^ would continue all three mechanisms 
of postdoctoral support: traineeships* fellowships and research associateships. 
If the person a student wants to work with is well established^ then it is easier 
for the student to get a competitive fellowship. A non-established person gets 
his postdoctorals on training grants. The training grant also allows an esta- 
blished man to have a flexible use of his laboratory. Research grants enable 
one to support foreigners. This mentor recommends that competitive fellowships 
permit a third and fourth year at a higher stipend. 

A somewhat differing view was expressed by a mentor who stressed that his 
critical need is for predoctoral support and as a result the major use of his 
training grant is the support of graduate students. Of the eighteen postdoc-* 
torals in the department only two are on the training grant. Klght of the rest 
are on fellowships » and eight are supported from research grants. He sees the 
postdoctoral period as a time of apprenticeship and encourages relationship 
among all groups in the department. 

A mentor to several of the postdoctorals whose views have been noted above 
explained that Investigators who are in fields that are overcrowded can afford 
to sit back and wait for people to come to them. There are not that many people 
Interested initially in pathology, for example, and it becomes necessary to go 
out and attract people who could make good money elsewhere. He argued that 
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out-backs in trainintj grant funds would iorvv the di.partnt.nt to enlarge its 
roHearch support and stili retain tl.e postdoctorals. In that rase, however, 
the objective would be research and not training. Most research In this country 
Is done bv postdoitorals or real research associates. He feels the present 
stipend forces people to sulfer. He Bets enouRh applicants, but he still 
thinks it awkward to pay so little. 

/Wther postdoctoral mentor with a medical background said that biomedical 
research Is in a phase of development which Is unprecedented in Its history. 
'I1li.s would not be the case if Nl|| had m.t been foresiKhled in the 195(>'s. If 
programs are curtailed now, institutions doing biomedical research will not be 
able to operate effectively in a decade or two. He sees the leading research 
laboratories as having the responsibility for training the future generations of 
scientists. To accomplish this the postdoctoral mechanism is essential, since 
medical school training is too general. We need physicians in research who can 
ask the human questions. 



(<un elusions 

On examining the results of this series of interviews. It appeared quite 
clear to the Comtttee that the postdoctoral fellowships and tralneeshlps were 
indeed of inestimable value, not only to those who received the stipends, but 
to the universities and to the development of biomedical science. This evidence 
pointed to the conclusion that the rate of progress in medirtne, and hence 
future improvement In the health of the populace was importantly dependent upon 
the retention of these programs, and that the social benefits far outweighed 
the cost of the programs to the taxpayers. However, this was but the first of 
the three sources of evidence sought. The testimony of tormer holders of NICMS 
postdoctoral fellowships and tralneeshlps was felt to be important, as would be 
also the hard statistical data on career outcomes and achievements. We turn now 
to the substance of letters received by the Committee from the former NlGMS fellows 
and trainees. 
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CHAPTER III 
TESTIMONY OF FORMER NICMS POSTDOCTORALS 



Another source of information regarding the value of the postdoctoral 
experience » and reactions to various alternative modes of support of research » 
was found in letters received by the Coimittee from former postdoctorals. 
Such reactions were solicited from a significant number of former NIGMS fellows 
and trainees who were working in a variety of settings in 1972 and whose career 
achievements, insofar as they could be Judged by publications and citations* 
were widely varied. The individual replies were not numerous enough to provide 
any statistical data* but were surprising both in their uniformity of endorse- 
ment of postdoctoral training* and in the description of the ways in which the 
postdoctoral experience had contributed to their own careers. 

Typical excerpts from these letters « whose authors must remain anonymous, 
are grouped under several headings, including opportunities for changing 
direction of interests, increase in skills, changes in the conditions of awards, 
and reactions to various proposed alternatives. 

Changed Direction of Interest 

**The postdoctoral experience made a very great change, because it enabled 
me to do research at an excellent medical school. Essentially, it introduced 
me to the research area which I did not feel I had by fulfilling my PhD thesis 
requirement. After receiving my FhD I had planned to go simply into teaching 
at the college level, but after my postdoctoral fellowship T felt competent in 
research and more prepared as a teacher as well.** *'It helped re-*orient my 
research inwerests from pure physical chemistry to physical biochemistry by 

providing the opportunity to work with Dr. . ** "I became 

interested in molecular biology instead of classical biochemistry. ** "Prior lo 
my postdoctoral experience I was concerned with inainly classical areas of biology 
The work done while a postdoctoral and thereafter influenced me to the study of 
plant and insect viruses as well as a variety of biomolecular problems that I was 
not previously interested in." "It has allowed me to develop some understanding 
of analysis and to use statistical methods with more than a *cook-book' approach. 
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Not ail postdoctorals changed their direction of effort. One simply 
faid, "No. The program 1 participated in was in line with my professional 
interests." "No change, but it did significantly aid me in updating my 
knowledge and techniques in protein chemistry and allowed me to initiate 
a course in bl<ichemistry here with greater confidence and competence." 
"It did not bring about a change in direction, rather an intensification 
of certain interests and efforts." 

Ik.crease of Skill 

"The postdoctoral period allowed me opportunity to develop skills in 
instrumentation (i.e.. gas chromatography, spectrophotometry, etc.) and in 
other chemical research methods." "In addition to learning electron micros- 
copy, I was able to build a background in X-ray diffraction and polarisation 
microscopy. Concentrating on these techniques provided me with a much 
broader point of view within my particular area of interest." "As a post- 
doctoral fellow I was able to acquire many of the 'modern' skills of cell 
biology particularly, electron microscopy, cell fractionation, spectroscopy, 
etc." "My graduate training was definitely limited in the area of quantita- 
tive genetics. My postdoctoral program enabled me to study statistics and 
quantitative genetics in depth." "I learned the use of ultracentrifuge and 
development of techniques for studying homology of base sequence." "I 
learned the skills of hypothalamic brain stimulation and leslonlng techniques; 
also the preparation of frozen brain sections to check the sites of leslonlng 
and brain stimulation." "I teach In a small school and had been devoting 
full time to general and organic chemistry. Though my training was In bio- 
physical chemistry I was in need of refurbishing." 
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IVo teat Awards - or One? 

Matters of arrangeisents for postdoctoral felloi^ahip aifards^^-^annual 
renewals and stipends » which have been much discussed in fellowship circles-*-* 
came in for discussion in the letters received from former HIGHS postdoctorals. 
There was no unanimity with respect to one*year vs. two-^year awards* and 
some of the writers felt that the stipend level should be increased. Examples 
of comments on this question were as follows: 

"I favor the requirement for yearly renewal (1) if the option exists 
for termination after one year* and (2) if the fellowship can be transferrer 
from one place to another* should the first position be unsuccessful." 
*'A two<-year fellowship would be better because an individual could plan his 
time." "Yearly renewal provides an automatic opportunity for a reassessing 
of the overall value of the fellowship." "I would suggest a stipend formula 
which would place the level of support at one-third to one-half the scale 
between a typical graduate assistantship and an average starting salary for 
an assistant professor." 



.38 



21 



Improvements 

Perhaps because they may have felt that it would seem ungrateful 
"to bite the hand that fed them," few former postdoctorals were critical 
of the general arrangements as they had experienced them; most had no 
suggestions for Improvements. A few did offer suggestions, such as the 
following! 

"Perhaps one Improvement might be to more critically evaluate the 
methods by which tratneeshlps are granted in individual programs. For 
example. It might be possible to have an ad hoc outside committeeman over- 
see the awards so that internal politics play less of an importance." 
"Better screening of laboratories and the directors who participate." 
•Speed up the selection process. Better information about your prospects 
when you apply. But I have no complaints. It's a good program." 



Alternative Modes of Support 

Letters from former NICMS postdoctorals were in general quite nega- 
tive with respect to the idea that postdoctoral funds might be spent In 
other ways, such as research grants, block grants, etc. Typical reactions 
were as follows: 

"Research grants should not be at the coat of eliminating fellowships, 
•ilock grantHi No, a j-o xi applicant should be able to choose his location. 
He Should not be limited to a place that has a grant." "Negative for using 
postdoctoral moneys for research grants. I perhaps favor institutional 
grants since it might insure a more even distribution of awards." "The 
training grant should not be superseded by research grants as they provide 
another degree of freedom to the student^^worklng under them than would 
ordinarily be true if the student were working on a research grant. Block 
or institutional grants are satisfactory, but they should have an appropri- 
ate supervisor. Again, perhaps an outside, unbiased committeeman should be 
involved in the fiscal policies of that grant." "No. Fellowships and 
traineeshlps spawn independent thinking and creativity by young investiga- 
tors." "There should be a separate category for postdocroral fellowships. 
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as now. I am not in favor of block grants as a substitute/* ^'Research 
grants ttre good» but I should not like to see the traineeships program 
discontinued. Block grants could be used for traineeships/* From a 
university administrator: '*Negatlve for substituting research grants for 
postdoctorals*. I think it is sounder to assign funds to individuals than 
Institutions because this makes It more flexible and because you will have 
better control of the final distribution of funds." But the dissent was 
not unanimous. One fellow from the early years» now teaching, comments: 
"For individuals in the small colleges* research grants have been most 
beneficial. It is very difficult to keep up in your field without some 
outside financial support. I like departmental grants » so that several 
individuals can work together in a small college and have an opportunity 
to cover research areas very thoroughly.'* 

Two fellows from more recent years enlarged upon their reactions to 
these ideas of substituting research grant or block grant funds for post* 
doctoral support as such. They said: "All three are lousy substitutes 
for training open^^ended basic researchers. The unrestricted post^oc lets 
a top prospect choose where he wants to go and whom he wants to work with. 
His salary doesn*t come out of his professor *s grant » so he has freedom to 
work up his own project. Research and institutional grants are instruments 
of governmental control over the direction science is to take. Both have 
their place." "I do not favor institutional grants because there would be 
too little control on disbursement of funds within the institution and the 
internal politics in the institution could work to give funds to unworthy 
investigators and deny funds to worthy investigators. (Of course « external 
politics could do the same* but this is less probable.)" 
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Conclusions 

The letters of former NIGMS postdoctoral fellows and trainees added 
further to the weight of testimony from the Interviews, giving quite eloquent 
evidence of the ways in which the postdoctoral training received under NIGMS 
sponsorship had indeed Improved the quality of research performed by the 
former postdwctorals. They gave further suppoi*- to the Importance of a 
balanced program, including competitive fellowships, traineeahlps, and 
grants-in-aid of research. These subjective opinions, it was felt, needed 
to be put to the test of objective statiotlcal evidence. Those who had 
benefited by the programs— or who were currently benefiting— were in favor 
of the programs, as might well be expected. Actual career achievement data 
were needed, to be analyzed regarding those who had had such postdoctoral 
training, and those who had not. The examination of such statistical data, 
to confirm or refute the opinions expressed up to this point, occupies the 
next chapters. 
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CHAPTER IV 

THE QUANTITATIVE DATA: RESEARCH STRATEGY 



The Interviews in poscdoctoral laboratories and letters from former NIGNS 
postdoctorals provided excellent qualitative evidence of the impact of the post- 
doctoral training on the lives and careers of those so supported-**fram the 
standpoint of those directly involved. The Coomiittee Judged » however » that it 
would be imperative to secure "hard data^-'-^quantitative information from sources 
unconnected with the program^ by which to evaluate the effects of training. 
From this point of view» the various kinds of evidence that were or might be 
made available were reviewed. The objective was to secure data frcm existing 
data banks \Aierever possible » thus avoiding the time^ expense » and annoyance 
to the scientific community that would be involved in sending out a question- 
naire. It was soon discovered that there were several excellent data sources » 
several of which provide information without any requirement for the cooperation 
of th^ people involved — such as counts of publications and citations » records 
of award of research grants » and attainment of certain identifiable stages of 
an academic career. The methods involved in the develoimient of these quanti- 
tative kinds of evidence deserve some detailed attention. 

Career Development Data 

The importance of postdoctorals to the medical schools and graduate schools 
had been brought out in the interview and letter data^ but not quantified. 
However » by reference to the files of the Association of American Medical 
Colleges y it was possible to determine how many of any particular group of 
people had actually been hired as faculty members in medical schools » and also 
the rank attained in the medical school. This offered quite hard» 
objective^ and quantitative information. Furthermore^ it should be possible^ the 
Committee decided » to set up some scale or index by which to sort out the medical 
schools according to the degree of research orientation they exhibited* As 
research is the primary objective of the postdoctoral trainings it would be 
to be more in line with the objectives of the program if rn individual should 
Join. the faculty of one of the strongly research-oriented institutions than if 
he should Join the faculty of a less<- research oriented school. It was in fact^ 
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. . be possible n set up such a scale (see Appendix A) and to use 

it as a further measm. of career achievement. 

Similar data were available regarding the careers of the academically- 
inclined who became members of graduate school facvlties. For a very large 
proportion of the cases, data were available through the National Register of 
Scientific and Technical Information, as of 1970, regarding employer and type 
of work performed. In addition, data were available for ^ substantial portion 
of those not ir. the Register through the National Faculty Directory. A third 
source of information, regarding the academically-employed only, is the Thesis 
Adviser File, developed in the Office of Scientific Personnel as an offshoot 
of the Doctorate Records File. For th. past decade, each new PhD has supplied 
information, at the time of graduation, that includes the name of his thesis 
adviser. This file. then, would give one indication of advancement up the 
academic ladder in the graduate schools. With respect to school quality, there 
was already available the Roose-Andersen ratings developed by the American 
Council on Education in 1970. Thus, several kinds of data were available, 
chiefly relating to academic careers, but not limited to them, as the National 
Register also contained data on employer categories other than academic, and 
major work activity regardless of type of employer. 

Career Achievement Data 

More than type of career was important, however, m assessment of career 
outcomes. The attainment of program objectives should be assessed, if 
possible, by quantitative measures of achievement that were not related to 
employer type or academic status. What additional quantitative measures might 
be found? One set of judgments that would be particularly applicable to the 
people engaged in research would be the winning of research grants in the stiff 
competition for such awards given by the National Institutes of Health or th. 
National Science Foundation. There are many applications for such grants 
which are carefully reviewed by panels of research scientists; only a fraction 
of such applications result in actual awards. The winning of such awards, 
therefore, can reasonably be considered to constitute a measure of scientific 
quality by the peers in one's research environment. It was determined that lists 
of such awards could be obtained to measure the performance of the NIGMS post- 
doctorals against the performance of other groups of PhD's. 
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All these measures appeared to be good» but the Committee had to consider 
whether a postdoctoral or any other ND or PhD who Stid not enter the academic 
world and did not seek or obtain a research grant from NIH or NSF» could » 
nevertheless 9 make important contributions to science and specifically to bio- 
medical science. The answer was certainly ••Yes"t and it was obvious that 
among these contributions might well be articles in the scientific literature t 
the typical modality by which the body of science is built up. Furthermore, 
prior research had shown that one could not only count scientific publications » 
but, better, count the citations to one's work in the scientific literature. 
That is, of two publications, that one which is most often cited by other re- 
searchers may be deemed to be making the greatest contribution to science* 
This will not always be true, of course, but by and large, across all the hun* 
dreds and thousands of publications, those which are most frequently cited are 
cited because they have been helpful to the work of other researchers. We 
have, then, from the scientific literature, two measures - publications and 
citations - that enable us to measure an individual's scientific contributions 
in ways that are quite clisely in line with the program objectives of the NIGMS 
postdoctoral traineeships and fellowships. 

What Comparative Standards? 

Granted that it is possible to collect the statistics cited above, how is 
one to Judge whether they are favorable t^r unfavorable, with respect to the 
program objectives? There arc certainly no pre-specificd numbers of publications 
or citations, or numbers for any of the quantifiable criteria. How may one 
Judge, then, the performance of the NIGMS postdoctorals against a fair standard 
of performance? The Committee chose to base its Judgment on the relative 
attainments of the NIGMS postdoctorals as conqpared with those of several other 
specified groups. One of these groups was to be a random sample of MD*s drawn 
from the same medical school graduation cohorts as were the NIGMS post--MD's. 
For the FhD's, there was to be a similar random sample drawn from the Doctorate 
Records File (DRF) maintained by the NRC's Office of Scientific Personnel. 
The Committee decided to go farther, however, and to use a "select sample'* of 
PhD's, matched with the NIGMS postdoctorals as nearly as possible, not only in 
terms of time of graduation, but in terms of field of specialization, institution 
of doctorate, and sex. Still other comparisons were possible, involving other 
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groups of postdoctorals. The National Science Foundation had for many years 
supported a postdoctoral training program very similar In many respects to that 
of the NIGMS, but with slightly different field emphases and somewhat different 
selection techniques. Another program, very small in numbers, particularly in 
the biomedical sciences, but very high In selectivity, was the Postdoctoral 
Research Program of the Air Force Office of Scientific Research. Although 
the numbers were small, it was deemed advantageous to take into account the 
accomplishments of this additional group. 

A caution was apparent from the first with respect to the use of these 
comparison groups. Even the "select sample" could not properly be called a 
"control group" m the sense in which that term Is used in laboratory science. 
People apply for and are selected for all sorts of training programs, and there 
is no way in the practical world where people with fully equal q.Uiflcations 
can be arbitrarily assigned to "trained" and "untrained" groups after the manner 
Of a controlled experiment. Yet, m spite of the many factors that would inevi- 
tably be beyond the scope of this research with respect to the abilities and 
motivations of the comparison groups, it was expected that these groups would 
furnish some sort of standard against which the performance of the NIGMS post- 
doctorals might be measured. As will be seen later in this report, additional 
refinements of technique permitted rather close tailoring of the samples and some 
control of extraneous variables, so that some of the comparison standards could 
fairly be said to reflect rather well the effect of training 2er se. 

In assessing the evidence from the statistical data, the Committee recognized 
that there are two possible kinds of impacts of a program in support of training 
such as the NIGMS postdoctoral program. One possible effect is that people 
may be induced to enter research careers who would not have done so but lot the 
avaiUbility of the necessary funds for advanced training. The other effect is 
that of facilitating and speeding the career development of people who have 
already decided upon research careers. By speeding the research career, the 
country would get the benefit of more of the best years of the researcher, as 
well as a larger total number of years spent in research activity. Both of 
these effects ai:e closely tied up with the matter of selection for postdoctoral 
training, and it was not expected that the study could untangle the relative 
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contributions of the postdoctoral support program to each of these kinds of 
results. In the unlikely event that the NIGMS postdoctoral program, although 
selecting good research-oriented people, failed to produce people who per- 
formed In accordance with the program objectives, that kind of negative evidence 
should at least becraie quite clear in the course of the analysis. On the other 
hand, it was recognized that If the NIGMS program had In fact supported superior 
individuals who were already headed toward successful research careers, at 
least the selective features of the program were working In the intended direction* 
The ConBQlttee took cognizance of these varying kinds of possibilities, although 
it could not expect, within the framework of the present study, to arrive at 
quantitative conclusions regarding the degree to which the various outcomes 
might be related to participation in the program. 

Using this orientation as a guide, the Committee examined preliminary 
data on careers and career outcomes, set up a series of quantitative measures 
by which the operationally-defined program objectives might be measured, and 
decided to conduct site visits and invite letters from former postdoctorals 
supported by NIGMS. Using this field experience as a guide, further refine- 
ments of the quantitative measures were decided upon. As the data developed, 
it became apparent that it would be important to consider quite separately 
the career lines and career attainments of the po8t-MD*s and post-PhO*s, 
inasmuch as the two types of careers are so different as to make many of the 
measures not directly comparable. In the report, the po8t-MD*8 are considered 
first, in part because of the greater complexity of the data regarding the 
post-PhD*s. However, as background for considering both of these sets of 
data, it will be advantageous to examine some information on the numbers and 
types of people supported by the NIOfS from the beginning of the program up 
to 1970. The next section deals with these data. 
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Background and Basic Data 



The extent to which postdoctoral education has increased in the United States 
over the last decade and a half is indicated in Table 1 and Figure 1. The post- 
graduation plans of new EhD's are shown by graduation cohort, the first nine years 
being grouped into three 3-year periods, the last five years being shown separately 
for greater detail. The table and figure show the data separately for three general 
fields of science. Engineering, mathematics, and the physical sciences (EMP fields) 
are shown first, then biomedical sciences, followed by the social sciences and 
finally all science fields combined. 

Tne data of Table I show a total for the period 1958-1970, because this is 
the period for which most of the data in this study were available. In addition, 
data on the 1971 PhD graduations and postdoctoral plans became available in time 
for Inclusion here, although other data tables necessarily terminated with 1970. 
The inclusion of 1971 data here extend the previous series, although other tables 
will not include this year. 

The growth in number t»f science doctorates is apparent on the bottom line 
of Table 1. The single year 1970 is larger in numbers - 18,252 - than the 18,159 
In the three-year cohort of 1958-1960— a tripling in slightly over a decade. But 
over this same period the number of postdoctorals has increased from 1,471 for the 
3-year period to 4,050 for the single year 1970— an increase of over 825%. It 
should be noted that, although the data of Table 1 and Figure 1 represent only plans 
at the time of graduation, various follov.-up studies have indicated that thes plans 
correspond well with actual outcomes. should further be noted that these are 
only immediate postdoctorals; many others enter training after a lapse of a few 
years. These are, of course, only the data on PhD's; post-MD training is In 
addition to these figures. 

It will be noted that there was a small but significant increase in the per- 
centage whose plans were uncertain in the 1971 data, reflecting the increasing Impact 
of the cutback in support programs at this point. In all fields the actual number 
of postdoctorals has continued to increase; in the life and social sciences the 
proportions Increased up to 1971, where a slight percentage decrease was recorded. 
Since 1969, over a third of all new PhD's in the biomedical sciences entered post- 
doctoral training on graduation. 

Over the 1958-1970 period, a total of approximately 8,420 new biomedical PhD's 
have entered postdoctoral training (Table 1, life sciences minus agriculture). Of 
these, 2,977 have had NIGMS support. (An additional 1,090 in engineering, math, 
and physical sciences, and 203 in the social sciences have also been supported by 
NIGMS.) Thus in the biomedical fields^ the NIGMS- supported people constitute about 
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TABLE 1 

Postdoctoral Plans of 1958-1971 PhD's 



Engineering* Math, and Physical Sciences 



Postdoctoral 
Plans 




FY 
58-60 


FY 
61-63 


FY 
64-66 


FY 67 


FY 68 


FY 69 


FY 70 


Total 
58-70 


FY 71 


XrOS CUOC CO& aJL 


N 


671 


1,600 


2.435 


1.042 


1.010 


1.639 


1.932 


10.329 


2.216 


Training 


Z 


8.1 


14.2 


14.7 


15.0 


13.5 


19.9 


21.4 


13.8 


24.0 


Bmployioanc 


N 


7,275 


9,249 


13.355 


5.615 


6.167 


6.282 


6.735 


61.140 


6.462 


% 


88.1 


82.3 


80.8 


80.9 


82.4 


76.4 


74.5 


81.8 


70.0 


uncerwain 


N 


307 


382 


740 


277 


307 


303 


372 


3,235 


547 




% 


3.7 


3.4 


4.5 


4.0 


4.1 


3.7 


4.1 


4.3 


5.9 


Total 


N 


8,253 


11,231 


16.530 


6.934 


9.484 


8.224 


9,039 


74.704 


9.225 












Biomedical Sciences 








ros CQOC wora j» 


N 


603 


1,299 


1.998 


835 


1.049 


1.470 


1.742 


8.996 


1.877 


Training 


1 


12.2 


22.2 


25.2 


26.6 


28.4 


35.7 


38.2 


24.1 


37.1 




N 


4,139 


4,376 


5.661 


2.181 


2.480 


2.491 


2.644 


26.830 


2,858 


X 


83.9 


74.9 


71.4 


69.4 


67.2 


60.5 


57.9 


71.7 


56.5 


uncsrbaxn 


N 


192 


165 


273 


126 


165 


158 


178 


1.573 


316 




X 


3.9 


2.8 


3.4 


4.0 


4.5 


3.8 


3.9 


4.2 


6.2 


Total 


N 


4.934 


5,840 


7.932 


3.142 


3.694 


4.119 


4.564 


37.399 


5.051 












Social Sciences 








Pna tiffin ^nVA 1 


M 


197 


353 


488 


208 


220 


329 


376 


2.171 


401 


Training 


z 


4.0 


6.. I 


6.6 


6.5 


6.1 


8.1 


8.1 


5.7 


7.7 




N 


4,509 


5,203 


6.476 


2.801 


3.167 


3.513 


4.041 


34.166 


4,438 


X 


90.7 


89.3 


87.9 


8d.l 


88.5 


86.5 


86.9 


89.0 


86.0 




N 


266 


271 


406 


169 


194 


219 


232 


2,073 


316 




% 


5.3 


4.7 


5.5 


5.3 


5.8 


5.4 


5.0 


5.4 


6.1 










7 

' » J7U 


3.178 


3.581 


4.061 


4.649 


38.410 


s lis 












All Sciences Coiid>lned 








Postdoctoral 


N 


1,471 


3,252 


4.921 


2.085 


2.279 


3.438 


4.0;-0 


21.496 


4.494 


Training 


Z 


8.1 


14.2 


15.5 


15.7 


15.4 


21.0 


22.2 


14.3 


23.1 


Employment 


N 


15,923 


18,828 


25.492 


10,597 


11.814 


12.286 


13.420 


122.136 


13.758 




z 


87.7 


82.2 


80.1 


80.0 


80.0 


74.9 


73.5 


81.1 


70.8 


Uncertain 


N 


765 


818 


1.419 


572 


666 


680 


782 


6.881 


1.179 




X 


4.2 


3.6 


4.5 


4.3 


4.5 


4.1 


4.3 


4.6 


6.1 


Total 


N 


18,159 


22.898 


31.832 


13.254 


14.759 


16.404 


18.252 


150.513 


19.431 



Source: Doctorate Records File» Office of Scientific Personnel 
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FIGURE 1 Postdoctoral plans of 1958-1971 PhO's 
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35% of the total - but again It must be noted that the NIGMS figures include not 
only the new graduates » but those entering such training at later dates. Another 
way of approaching the relative contribution of the NICMS to this field Is to 
note the total number of post-*FhD*s and post»Mt>*s supported by NIGMS In each year 
from 1958 through 1970. These data are given In Table 2» tt imist be remembered » 
In interpreting Table 2, that these data Include the same Individual In more than 
one year if the tralneeship or fellowship extended over two or more years. These 
data» then represent a level of support » rather than numbers of different indivi- 
duals. The rlght<*hand portion of this table shows the number of thousands of 
dollars of support In each year» separated Into tralneeship and fellowship cate- 
gorles» and combining post-^BiD's and po8t-MD*s. The total expenditures » approxi- 
mately 86.5 mllUont are the equivalent of about $S»8S0 per man-year of support 
over the period shown. From a beginning in 1958 with 48 people supported, the 
program has grown to 1»767 people supported In fiscal 1970. The greatest growth, 
however, was In the first six years; since 1963, growth has been moderate in 

numbers, while costs have continued to rise more steadily because of inflation 
and Increases In stipends to try to keep up with the rise in the cost of living. 
These data are shown graphically in Figure 2. The number of people supported 
each year Is shown by the upper line, with the scale at the left. The %cl ars 
expended each year Is shown by the lower line, with the scale at the right. 
The tendency for the two lines to converge in recent years Is a reflection of 
the inflation of costs. 

This furnishes a general background with respect to postdoctoral education 
In the biomedical sciences, as the situation existed when the NIJMS requested 
the NRG to undertake an evaluative study of their postdoctoral program. The 
next paragraphs give a general description of the categories of people supported 
by the NIGMS and relate these categories to the plan of the evaluative study. 

Categories of Postdoctorals 

The MIGMS began its postdoctoral program in 1958| and from the beginning 
Included both post-FhD*s and post-MD^s in its training program. Two general 
types of training were provided: fellows, who were selected in a national 
competition, and trainees, who were locally selected by departments which had 
been awarded training grants by the NIGMS. (Training grants had an additional 
dimension ^ their impact on institutions and the development of training programs 
carefully tailored to biomedical needs. But these aspects are a separate 
story, which we will omit here.) Although the programs of study were not 
substantially different for the trainees and fellows, that they were selected 
by different means opens the possibility of their having different initial 
qualifications, and hence of possible different career outcomes related 
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TABLE 2 

Nuiabers of Post-MD'a and Post-PhD's Supported by NXGMS in Each Year, 1958-1970 
and Dollar Expenditures in Each Year for Tralneeahips and Fellovahlps 



Fiscal 


NuiBbera of People Supported, 
by Year of Award 


Thousands of Dollars, 
by Fiscal Year on Dutv 


Year 


Post-MD 


Poat-PhD 


Combined 


Tralneeahips 


Felloifships 


Combined 


1958 


36 


12 


48 


150 




150 


1959 


152 


64 


216 


652 


60 


712 


I960 


269 


163 


432 


1.258 


533 


1,791 


1961 


364 


239 


603 


1.970 


755 


2.745 


1962 


632 


505 


1,137 


3.852 


1.353 


5,204 


1963 


825 


646 


1.471 


4.852 


2.294 


7,146 


1964 


854 


713 


1,567 


5.413 


2.675 


8,088 


1965 


761 


675 


1»436 


5,096 


2.145 


7,241 


1966 


741 


694 


1.435 


5.179 


2.525 


7,704 


1967 


741 


721 


1.462 


5.530 


3.452 


8,982 


1966 


777 


786 


1.563 


6.580 


4.275 


10,855 


1969 


820 


827 


1.652 


7.715 


4.712 


12,427 


1970 


830 


937 


1,767 


8,403 


5.102 


13,504 


lOTAL 


7,807 


6,982 


14,789 


56.650 


29.901 


86,551 
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FIGURE 2 

NIGMS postdoctorals supported » and annual costs, by year, 1958-1970 




Fiscal Year of Support 
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to these initial di£Sesenaes»- Asvill be seen* this can become ImportAflt f^hdti * * ' 
outcome data - professional achievements - for these groups are compared with 
those for other groups chosen to provide a normative framework for interpretation 
of results. A minor problem arose because some individuals (a small portion of 
the total) had held both fellowships and tralneeshlps . Most of these appeared to 
be fellows who were given tralneeshlps for brief periods before their fellowships 
became effective. The problem was resolved by placing each Individual in that 
category in which he had received the most months of training. This had the 
effect of classifying most of this group as fellows, and thus in the category with 
the most explicit selection requirements. There was a total of fifty-one people 
who had both the PhD and MD degrees. These people are counted twice in Tables 
3 and 4 (i.e., they are included in both the MD and the PhD figures). 



Senior Postdoctorals 



Another distinction which affects possible interpretation is the age and 
amount of experience the individual had received prior to entrance upon the 
fellowship or traineeship. A great many of the individuals supported had just 
completed their doctorates, while others had had many years of prior experience. 
It was necessary then, to provide some distinctions based on such prior exper- 
ience. It turned out to be useful to make a simple dichotomy into what have 
been termed "regular" .nd "senior" postdoctorals. adhering as nearly as possible 
to the definitions (necessarily arbitrary) used for many years in the domain of 
postdoctoral work. Senior postdoctorals are defined as those more than five 
years past the doctorate for the PhD's. and over eight years past the doctorate 
for the MD's. to allow extra time for the internship and residency. There was 
one further distinction which affected primarily the stipend provided, rather 
than the training itself. A number of the fellows and trainees were at an advanced 
career stage where they could not afford to undertake training on the standard 
stipend. They were termed "specials" and a stipend was determined on a basis 
which would permit their leaving their regular employment to undertake the train- 
ing without undue loss of income. As this was a financial arrangement, rather 
that an educational one. and inasmuch as it would be highly correlated with length 
of experience, this was a distinction which it was felt could be disregarded in 
the evaluation of outcomes. 

The numbers of trainees and fellows, of seniors and regulars, both 
post-PhD and post-MD, are shown in Tables 3 'and 4. In Table 3 it is seen 
that about 15% of both the PhD's and MD's are in the senior category. 
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TABLE 3 

Proportions of NIGMS Senior and Regular Postdoctorals, by PhD and MD 
Categories, 1958-»197Q 







Post FtkD 


Post J® 


Total 


Senior Postdoctoral 


N 


660 


686 


1346 




% 


L5.1 


15.9 


15.5 


Regular Postdoctoral 


N 


3713 


3626 


7339 


% 


84.9 


84.1 


84.5 


Total Postdoctorals 


M 


4373 


4312 


8685 




% 


100.0 


100.0 


100.0 



It Is also apparent from Table 3 that the program divides almost evenly 
between post^RiD's and post-MD's. The division between trainees and 
fellows, however, is different for MD's and PhD's as shown in Table 4. 
The post-fhD's divide 55/45 between trainees and fellows, respectively, while 
for post-MD's the division is 90/100} conversely, 62Z of the trainees were 
post-4iD's, while 83Z of the fellows were post-PhD's. 

T^LB 4 

Proporciona of MIGMS Trainees and Fellows, for MD*s and PhD*s, 1958-1970 







Post PhD 


Post W 


Total 


Trainees 


M 


2384 


3898 


6284 




X 


54.5 


90.4 


72.4 


Fellows 


M 


1989 


414 


2401 




% 


45.5 


9.6 


27.6 


Total 


N 


4373 


4312 


8685 




% 


100. 0 


100.0 


100.0 



Because both the training and the normal careers of rhaJ-i are so 
different from those of MD's, the two groups of postdoctorals have been 
kept distinct throughotit the evaluation study. Within each of these groups, 
the differences between regular and senior postdoctorals also require that 
they be treated separately in much of the analysis. However, the kinds of 
career outccmes for post-fhD's, whether regular or senior, would be expected 
to be the same in kind, although perhaps differing in quantitative terms. 
The sane could be anticipated for the pcit•-^0)'s. The data on the DOst-MD'n 
will be considered first. 
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CHAPTER V 

THE POST-MD'S: CAREER PATTERNS AKD ACHIEVEMENTS 

The careers of m*s who take postdoctoral research training such as that 
afforded by NICMS traineeshlps or fellowships are quite different from those 
of the typical MD who enters clinical practice. Their career motivations are of 
course different, or they would not have applied for the postdoctoral training 
in the first place. A great many take this training because they plan careers 
m academic medicine, and are keenly aware that medical schools are Increasingly 
requiring such training for new additions to their faculties. 

As one comparison group for the NIGMS post-MD's, a typical sample of MD's 
of the same medical school graduating classes were examined for comparable data. 
This was done by selecting a ten percent random sample from the computer tape made 
available by the American Medical Association regarding all m^nbers of the medical 
profession, whether members of AMA or not. This tape, of course, included the 
Nl®fS post-MD's, but only In the proportion their numbers bear to the total of 
all MD's of the same graduation cohorts. T».i. overlap was eliminated; however, 
trainees of other NIH programs, who could not be identified, remain in the random 
sample of physicians. For purposes of analysl,. the post^'s were divided into 
two groups, a "pre-Wei" cohort, and a 1961-70 cohort. These terms should 
perhaps be defined more clearly. For the NIGMS cases, it means all postdoctorals 
whose MD's were earned at any time prior to 1961. Most of them were earned in 
the late 1950's, but the group included a few senior trainees and fellows whose 
MD's were earned considerably earlier. For the random sample drawn from the AMA 
tape, however, a definite cut-off date was established because it would not be 
reasonably to include all the pre-1961 graduates. Consequently, the group actually 
includes a ten percent sample of all MD's on the AMA tape whose degrees were earned 
in the 1957-1960 period. The later cohort represents ten percent drawn at random 
irm the MD graduates of the 1961-70 period. The same strict time limits apply 
to the NIGMS post-^©•s for the later cohort. 

To afford further comparison with the NIGMS post-MD's. data are presented 
also for the NIOIS post-PhD's. The post-PhD's were divided into an early pre- 
1964 cohort and a later 1964-70 cohort, the cut-off dates being different from 
those for the MD's, which allowed time for the internship and residency years. 
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TABLE 5 

Numbers and Percentages of NIGMS Postdoctorals and Comparison Groups Who Became 
Members of Medical School Faculties » by Time Period of Graduation 



Itedical School Faculty Status 











Medical 










Other 




Comparison 




Grand 


School 


Full 


Assoc. 


Asst. 




and 




Group 




I Own 1 


Pa All 1 

Fttcuixy 




rroi ■ 


prox . 


T A At- 


unknown 


Total 


NIGMS 


N 


4261 


14B0 


182 


384 


642 


215 


37 




Post-MD's 


% 








OA 1 
AO . J 






2« O 


Total 


Random Sample N 


14933 


1036 


38 


162 


459 


347 


30 




of Physicians 


% 


1 no A 




1 7 






MA K 


O A 


Total 


NIGMS 


N 


4322 


807 


R8 


189 


451 


63 


16 




Post-PhD's 


% 


100.0 


18. 7 


10 9 


23 4 


55 9 


7 R 


9 A 


Total 


NIGMS Post- 


N 


51 


20 


1 


7 


12 


0 


0 




MD/PhD's 


% 


100. 0 


39 S 


5 0 


35 A 


An A 


A 


A 


Pre-61 


NIGMS 


N 


2314 


971 


178 


341 


360 


71 


21 




Post-MD's 


% 


100. 0 


42 O 








7 "1 




Pre-Gl 


Random Sample 


N 


4592 


491 


30 


136 


214 


97 


14 




of Physicians 


% 


100. 0 


10. 8 


A • 

6. 1 


27.7 


43.6 


19.8 


_ A 

2.9 


Pre-64 


NIGMS 


N 


1907 


421 


88 


160 


154 


10 


9 




Post-PhD 's 


% 


100. 0 


22 • 1 


20.9 


38.0 


sr. 6 


2.4 


2.1 


1961>70 


NIGMS 


N 


1947 


489 


4 


43 


282 


144 


16 




Post-MD*s 


/" 


100.0 


25.1 


0.8 


8.8 


57.7 


29.4 


3.3 


1961-70 


Random Sample N 


10341 


545 


8 


2r 


245 


250 


16 




of Physicians % 


100.0 


5.3 


1.5 


4.8 


45.0 


45.9 


2.9 


1964-70 


NIGMS 


N 


2415 


386 


0 


29 


297 


53 






Post-PhD 's 


% 


100.0 


16.0 


0.0 


7.5 


76.9 


13.7 


1. 8 



The Committee first considered the percentage of each group found to be on 
the faculties of medical schools. These percentages were obtained by matching 
these groups against the computer tapes maintained by the Association of American 
Medical Colleges* 

Table 5 shows tho academic rank of the members of each of these groups « so 
that not only the fact of membership on a medical school faculty is available, 
but also the rank on the academic ladder which these groups have attained. 
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Hie first line of Table 5 shows that, of the 4,261 NIGMS post-MD's, 
1.460, or 34Z were found on the AAMC Faculty tape. This compares with 1,036, or 
7% of the random sample of 14,933 physicians on the AMA tape and 807, or 19% of 
the 4.322 NIGMS post-PhD's. The comparison is not strictly that of persons 
having postdoctoral training with those who have not had such training, as a 
few of the physician random sample presumably had postdoctoral training under 
other programs. It is a comparison of the specific group of NIGMS postdoctorals 
with all physicians of the same graduation period, including those with post- 
doctoral training from other sources. Finally, n t as a comparison group, but 
rather as a special group of NIGMS postdoctorals, those who hold both MD and PhD 
degrees and had NIGMS postdoctoral training, are shown on line 4. Of this small 
group of 51. 20 people, or 39%. were medical school faculty members, none below 
the rank of assistant professor, and none in administrative positions. 

Going on down the page In Table 5 we find a breakout of the same groups 
by graduation cohorts. These data are shown graphically in Figure 3. These 
further breakout indicate the importance of the time element, as some of the 
trainees and fellows were still in training status at the time the AAMC tape 
was prepared; it would have been Impossible for them to hav- completed their 
training and to have moved to faculty positions. The same is true, of course, 
for the random sample of physicians from the AMA tape. With this in mind, one 
may note that 42% of the early cohort of NIGMS post-MD;s are on medical school 
faculties, as compared with 11% of the corresponding normative group of physicians. 
For the later period. 25% of the NIGMS post-MD's are found on the faculty roster, 
as compared with 5% of the random sample of physicians. For the PhD samples, wc 
note that 22% of the early cohort and 16% of the later cohort of NIGMS postdoc- 
torals are on medical school faculties. 

The foregoing employs only the data on faculty membership; It does not 
exhaust the information of Table 5 which gives also the faculty rank or position 
attained by the members of the various groups. For the purpose of this tabula- 
tion, the four standard faculty ranks were included. The few who were classified 
as teaching or research assistants, administrators, or whose positions were 
not specified on the AAMC tape, are shown in the final column. 
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The data shwing the proportion of each group found to be on a medical school 
faculty* as shown by the AAMC tape» are depicted graphically In Figure 3. 
The proportions of the faculty members In junior ranks (Instructor^ assistant 
professor) and senior ranks (associate professor* full professor) are shoim 
In Figure 4. 

The outstanding record of the NIGMS post-MD^s with respect to attaining 
positions and advanced rank In medical schools shows up clearly In Figures 3 
and 4. Figure 3 requires no further comment. Figure 4 shows the difference 
between the early and later cohorts* as might be expected. In the most recent 
cohorts* there are few with advanced faculty rank* as compared with approxl* 
mately half In the older cohorts. The difference between the post^-MD's and the 
random sample of physicians Is also readily apparent. In making this particular 
comparison* It should be born In mind* as mentioned earlier* that the random 
sample pre&;umably also contains postdoctorals supported by other sources* but 
In unknc umbers. It Is also of Interest to note In Figure 4 that* for those 
who h^- faculty appointments* the rate of advancement of the post-PhD^s 

Is ev greater than that for the post-MD's.. The conqparlson between the 
MD*s and FhD*8 may not be of significance, but two possibilities come to mind to 
account for the fact that the RiD*8 have a slight edge In terms of advancement 
up the academic ladder. It Is possible « considering the smaller percentage of 
the post** PhD 's who have attained medical school faculty status* that they have 
been more rigorously selected. It Is more probable* however, that the difference 
lies more In the schools on whose faculty they serve. Data to be shown below 
Indicate that the po8t-MD*s, on the average, are employed by older and more 
prestigious Institutions; the post-FhD*s Iiave been employed In greater proportion 
by the less prestigious and newer Institutions. They may, therefore, be func- 
tioning in an environment in which advancement is easier because of expansion 
of medical school faculties. 

It is possible to secure yet another criterion of career achievement from 
the data on the proportions of the various groups who are found, by searching 
the AAMC tape, to be employed by medical schools. It can be argued quite 
cogently that it is a greater achievement to be enqployed by one of the more 
prestigious medical schools than one without an outstanding national reputation. 
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FtGURC 3 

Percentage of NIGMS postdoctorals and comparison groups on medical 
school facurtles» 1970, by graduation cohort 
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FIGURE 4 

Faculty ranks of NIGMS postdoctorals and cowpartson groups employed 
by medical schools in 1970, by graduation cohort 
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undoubtedly the institutions vary 1„ their .eloctlvlty. md posts In the more 
prestigious institutions, which are also the more research-oriented, are 
sought after much more vigorously, may well. then, use an Index, or score, 
based on evidence of research orientation, if one can be derived, as another 
measure of achievement, and examine the results for the various comparison 
groups in these terms. 

Medical School Research Orientation 

There has bee . no nationally-recognized assessment of the medical schools 
analogous to that provided by the Cartter ratings and Roose-Andersen ratings 
of the graduate departments. And yet it Is widely accepted that not all med- 
ical schools are alike, and certainly not all have the s»„e research-orientation, 
which is a quality pertinent to the present study. Various sources of quantitative 
data regarding medical schools were therefore examined to see whether they might 
afford some basis for such a ranking. It was found that a number of quantitative 
indices were available, and that they tended to place the schools i„ approxlmatelv 
the same order. These factors were: (1) the percentage of the school's alumni ' 
who were later themselves employed as medical school faculty; (2) the percentage 
of nlum.1 who passed one or more U.S. Specialty Boards and (3) the percentage of 
the whole student body who were graduate students or postdoctorals. 

These three factors were combined In a simple empirical formula, producing a 
grouping Of the medical schools with respect to the above-mentioned qualities 
appropriate to this study. The formula and the six groups of medical schools, 
designated by letters A through F. are given In Appendix A. No brief Is held for 
the exactness of the scale, nor for the placing of any individual medical schoo, . 
It is the sets of schools in the several groups that are Important for the 
present purpose, which Is to determine the extent to which the NICMS postdoctorals 
sought and attained appointment. In types of medical schools most appropriate to 
their research training. 

Use of the Research-Orientation Groups 

The rese«rch-orientatlon groupings were used In the following manner: The 
percentage of each of the postdoctoral groups (and the AMA random sample for compari- 
son, Who were, m 1970. employed In Institutions of each category wer computed. 
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By assigning numerical values to the several categories » an average index or 
score for institution of employment was derived for the various postdoctoral 
groups and for the AMA random sample comparison group. 

When the mean "research-orientation score" was computed for each of the 
groups of NIGMS postdoctoral trainees and fellows » it was found that the cohort 
differences found with respect to the faculty rank did not hold up* However » 
other differences did appear » between the trainees and fellows* Among the 
post^MD trainees » a small but reliable difference appeared between the regular 
and senior trainees - but in the opposite direction to what might have been 
expected. A difference appeared » also» between the post^CD^s and post-PhD*8» 
as was mentioned earlier. The MD*s were found on the average » to be employed 
by slightly higher-scoring medical schools than were the PhD*8. Within the 
various NIQfS oost-PhD groups* no significant differences appeared. The research-- 
score means for the institutions of employment of all the NIGMS postdoctoral 
groups are shown in Table 6. 

TABLE 6 

If 

Medical School Research^-Orientation Means of NIGMS Post-MD and Post-PhD 
Fellows and Trainees » Regular and Senior* in Two Time Period (Those on 
Medical School Faculties) 





Post-MD 's 


Post-PhD's 


MD/PhD's 
Total 


Trainees 


Fellows 


Trainees 


Fellows 


Reg. Sr. 


Reg. Sr. 


Reg. Sr. 


Reg. Sr. 


Pre-1964 
1964 et aeq 


4.03 3.59 
3.99 3.60 


4.27 4.25 
3.94 


3.80 3.87 
3.84 


3.91 3.82 
3.84 




Total 


4,01 3.59 


4.15 4.19 


3.82 3.87 


3.87 3.82 


4.00 



* A dash indicates fewer than five cases; MD/PhO*8 not broken out by time. 



A somewhat different view of the same data is provided by Table 7» 
in which the numbers and percentages of the members of each of the comparison 
groups (combining cohorts) are given for each of the research-orientation cate- 
goriea» A through F. There is also a category of medical schools too new to have 
accumulated the data used for computation of the prestige score. This group is 
shown as un-^rated in Table 7. The table also includes » for purposes of comparison* 
data on the random sample of physicians. 
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TABLE 7 

Numbers and Percentages of NIGMS Fellows and Trainees, Post-MD and Post-PhD. 

and Random Sample of Physicians, in Each Medical School Research-Orientation 
Category. All Cohorts Combined 



Postdoctoral 
Group 



Total 



Research-Orientation Groups 
B C D E 



Post-MD Trainees 
Post-MD Fellows 



Random Sample of 
Physicians 



Pust-PhD Trainees 
Post-PhD Fellows 
MD-PhDV^'Yfotal) 



Unrated 




Th. especially interesting data of Table 7 are the markedly higher pro- 
port una of the post-M».a. aa co^ared „Uh PhD'a. who are on the faculties 
of the highest-rated category of medical schools, within the MD group, the 
A «roap concentration of the fellows Is also ,„lte evident, hut even the 

ay Of he PhD groups. The last colu™ Is of considerable Interest also, u 
sKows that the newer «dlcal schools, which have not been 1„ operation long 
enough to have generated the data used for computation of the prestige scores 
employ relatively more PhO-s than M^'s. as compared with the slols in 
ra ed categories. The data for the MKPhD postdoctorals Is presented for com- 

eteness saKe; because of the small number of cases, no statistics, conc.u- 
slons are warranted for this group. 
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Contributions to Biomedical Research 

One of the objectives of the NIGMS postdoctoral training program was to 
upgrade the faculties ol medical schools by providing teachers with research 
training and experience. The foregoing data show that this objective has» in 
fact> been accomplished to a considerable extents The postdoctorals, both 
trainees and fellows, have been employed by medical schools in proportions 
far greater than have physicians who have not had such training. Another 
objective of the program was that of enlarging the number of people doing 
research and contributing to the growth of biomedical science. The question 
then becomes one of measuring in some way the contributions the postdoctorals 
have made» as compared with the contributions of the random sample of phyal-* 
cians» few of whom have had postdoctoral training. 

Publications and Citations 

Because science is, almost by definition, a public body of knowledge, 
contributions to the scientific literature constitute the building blocks of 
science. While books constitute key elements, the chief day-to-day building- 
stones in this edifice are articles appearing in the scientific journals. One 
measure, then, of a scientist's contribution to the body of science Is the 
number of his articles that appear in the journals. Not all of these articles, 
however, are of equal merit— not all the stones are of the same dimensions. 
As each article usually cites several preceding ones, the citations outnumber 
the publications several times over. A typical article might be cited four or 
five times* Some may never be cited. Others are cited hundreds or thousands 
of times, and are of such key importance that they continue to be cited for 
years— even decades. Although occasional articles may be cited for reasons 
o«!her than major contributions (correction of error, for example), such 
citations are not frequent enough to have a significant effect on the statistics. 
The chief contributions are the frequently-cited articles. From this it follows 
that those scientists who make the greatest contributions, by and large, are 
those who contribute the articles that are most frequently cited. Consequently, 
the simplest way of measuring the over-all effect of a given scientist on the 
growth of science is to count the number of tim^s his works are cited. We thus 
have two measures by which an individual's impact on science is measured — by 
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the number of his publications and the number of his citations. The latter are 
generally deemed to be the more conclusive evidence of scientific stature. (See 
Appendix B, page 112.) 

It must be recognized that neither of these measures Is perfect. Some works 
of deep Insight and significance are unnoticed for a long time, as for example 
those of ^tendel. Some scientists make highly Important contributions through 
their administration of programs of science, the outputs of id^lch are published 
by others. Some make their chief contrlbutlons-and vitally Important ones- 
through the teaching of science both to students who will be future scientists 
and to a more general public whose understanding of science la essential to its 
public support. No single measure, and no combinations of measures practically 
available at any given time, can thus constitute a completely valid criterion 
of any person's contributions to science. But among those that are practically 
available, the number of citations In the literature is one of the best, and a 
count of publications (which must pass critical scrutiny to get published at 
all) is not far behind as a measure of an individual's scientific merit. For 
these reasons, attention was turned to means of ascertaining the publications 
and citations attributable to each member of the NIGMS postdoctoral groups and 
the associated comparison groups. 

One could ask each lndlvldu.1 In a group under study to autalt a biblio- 
graphy. ,n the past this has .o»etl«, been done, but In the present case It 
was deemed Infeaslble and unnecessary. Such a request would Impose a very 
considerable burden not only on the NlGW-supported Individuals, but also on the 
member, of the comparison groups. Also, common sense and actual experience 
indicate, that not all Individual, who are asked to submit bibliographies would 
do so. Finally, such bibliographies would provide only the minor answer- 
publications, but not the major one— citation. i,.. 

J ■ one citations. One has no way of knowing all 

the citation, that may be made to hi, work olrh..„.k i. . 

' although he may know of many of them. 

For all of theae reasons, a different and more satisfactory method-although 

not a completely satisfactory one-was used: utilization of the Science Citation 

index and h,bllcatlons Index, maintained by the Institute for .Scientific Infor- 
mat ion. 



A Computerized Sourct? 



eomput::::rL':/:r;„:u..::r''r r ~ - 

list.-* oi pui) 1 icatiuns in the <tr{,.nf t t t., it^ 
KiKii 1, sciiMitlflc literature. Inrludinc the 

HihUogtapbl. attached to t,.o»„ publications. ,,„.. 
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was under way, such computerised lists were available for the publication years 
1961 and 1964-70. The lists include principal authors and co-authors of the 
published articles, but name only the principal authors of the cited works occuring 
in the bibliographies that follow the publications. The method of listing the 
citations allows for exclusion of self-citations, and this was done In the counts 
that were made for this study. These counts are shown In Tables 8 and 9, and 
Figures 5 and 6. It was later discovered that the group differences shown by 
these figures were somewhat too conservative, due to the problem of fully identi- 
fying the individual authors. That is, people with names that appear more than 
once in the file are not clearly distinguished. In the data that appear here, 
the publications and citations counts for such people were divided by the number 
of times each name appears, thus averaging the counts for all such multi-person 
names. It was found that such averaging tends to reduce the range of scores, as 
the very prolific authors are averaged In with those who publish little or not at 
all. The people whose scores are so averaged are, also, quite possibly, in two 
or more of the groups being compared. The result, therefore, is to reduce group 
differences, and hence to produce conversative results. However, because the 
group differences that were found were so strong and clear-cut, no further refine- 
ment was attempted at this point. For the somewhat more complex analyses per- 
formed with some special groups in the study of PhD career outcomes, to be reported 
later, further measures were taken, as described at that point. 



Postdoctorals Publish More 

Table 8 shows quite clearly that the NIGMS post-MD*s were not only much 
more likely to publish, but that those who did publish had more articles in 
print in the scientific literature. The top lines of Table 8 show the data for 
all graduation cohorts coiabined, for the NIGMS post-MD's and for the random 
smaple of physicians. Of the NIGMS group, over 86% had publications; of the 
random sample, 59% had publications in the scientific literature. The number 
of publications is shown in the last three columns, which give data for the 
25th percentile, the 50th percentile (median) and the 75th percentile, respec- 
tively. The 25th percentile column indicates that, of those who had any publi- 
cations, 25% of the NIGMS group had at least 1.81 publications, as compared 
with .83 for the random sample. The median number of publications for the NIGMS 
group was 4.25 as compared with 2.01 for the random sample. Finally, the last 
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TABLK 8 



Publications of NIGMS Po8t-MD'« and Random Sample of Physicians, by Cohort of Graduation 



Graduation 
Cohort 



Total 



Pre- 58 



1958-60 



1961-63 



1964-66 



1967-70 



Comparison Total N 

Group in Group 



» 

NIGMS Post-MD*8 I 4312 

I 

AMA Random Sample i 14933 

i 

NIGMS Post-MD's 1446 

ANA Random Sample : 883 

NIGMS Post-MD's 871 

AMA Random Sample 2838 

NIGMS Post-MD's 926 

AMA Random Sample 3228 

NIGMS Post-MD's 760 

AMA Random Sample 3243 

NIGMS Post-MD's 309 

AMA Random Sample 4741 



Total With 
Publications 



Numbers of Publications: 



25th 



75th 



Number % Percentile Median Percentile 



3743 
8796 

1267 
564 

782 
1840 



625 
1876 

237 
2504 



86.8 
58.9 

87.6 
63.9 

89.8 
64.8 



832 89.8 
2012 62.3 



82.2 
57.8 

76.7 
52.8 



1.81 
0.83 

2.20 
0.98 

2.37 
1.01 

1.85 
0.88 

1.41 
0.84 

1.02 
0.65 



4.25 
2.01 

5,'jb 
2.32 

5.67 
2.52 

4.12 
2.13 

3.00 
1.98 

2.09 
1.55 



10. '9 
4.56 

14.59 
6.19 

13.36 
6.59 

8.50 
5.02 

6.04 
4.17 

3.90 

3.75 
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FIGURE 5 

Publication counts of MIGMS post-ND's and random sample of physicians « giving 
medians and quartlles by cohort 



Random Sample of Physicians NIGMS Post-MD's 
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column shows that 752 of the NIGMS group had 10.49 ot fewer publications - 
the most prolific 25% of the group had more than that, lu the random sample, 
the top 25% had 4.56 or more publications, by way of comparison. Figure 5 
presents these data graphically. 

The rest of the table is to be read in the same way, cohort by cohort. 
It is quite apparent that the early cohorts had more publications, and that 
the higher publication rate for the NIGMS group increases with time since 
graduation. For the earliest cohort, the median number of publications of 
the NIGMS group is more than twice that of the random sample, and furthermore, 
88% of this group had publications, as compared with only 64% of the random 
sample. Going on down to the more recent cohorts, the difference between the 
NIGMS group and the random sample diminishes, but is still clearly apparent 
even for the 1967-70 group, where most of the NTOMS post-MD's, were still in 
training. Previous studies have indicated that, for PhD'o, remaining in study 
status tends to retard early publication, in comparison with those who enter 
employment directly. However, in the case of the post-MD's, 77% of the most 
recent cohort have publications, and, for these, the mediam number of publi- 
cations is 2.09. as compared with 1.55 for the 53% of the landom sample who 
have publications. The reduced inter-group difference for the recent cohort 
gives some hint of publication delay related to the extended training, and the 
data on citations tends to point in the same direction, as shown by Table 9. 

Table 9 gives data similar to that of Table 8. but it concerns the 
numberb of citations by others in the scientific literature. Here the data are 
even more striking than for publications. The column on numbers with citations 
is omitted as redundant in Table 9. The data on median number of citations, 
and the corresponding data at the 25th and 75th percentiles, shows that, for 
Che RsrlJest ^ort, the citation rate is almost four times as high for the 
NIGMS post-MD's as for the random sample of physicians. As with the publications 
table, the inter-group difference diminishes as we go toward the later cohorts, 
and is actually reversed for the most recent cohort. This is probably a function 
of publication lag, as referred to in the preceding paragraph. The publications 
of the NIGMS group, if they were delayed by a year or so. had not had sufficient 
time to be cited. The fact that the inter-group difference is persistent and 
increases over time indicates that it is probably such a lag. rather than differenc. 
in merit of the publications of the more recent cohorts, that accounts for the 
trend shown. These data are depicted graphically In Figure 6. 



4 
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TABLE 9 

Citations of MIGMS Post-MD's and Random Sample of Physicians, by Cohort of 
Graduation 



Graduation Comparison 
Cohort Group 



Nuinbers of Citations: 

Total N 25th 75th 

in Group Percentile Median Percentile 



Total 



mots Post-MD's 4,312 
AMA Random Sample 14.933 



1.62 
0.81 



8.85 
3.37 



34.05 
13.48 



Pre-58 NIGMS Post-MD's 1,446 

AMA Random Sample 883 

1958-60 NIGMS Post-MD's 871 

AMA Random Sample 2»838 

1961-63 NIGMS Post-MD's 926 

AMA Random Sample 3>228 

1964-66 NIGMS Post-MD's 760 

AMA Random Sample 3>243 

1967-70 NIGMS Post-MD's 309 

AMA Random Sample 4»741 



4.02 
1.19 

3.09 
0.99 

1.29 
0.80 

0.62 
0.70 

0.38 
0.73 



19.76 
5.21 

13.55 
4.65 

6.47 
3.38 

3.18 
2.87 

2.05 
2.60 



62.36 
19.66 

42.21 
17.49 

24.26 
13.11 

11.99 
11.39 

8.17 
11.11 
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FIGURE 6 

Citation counts of NIGMS post-MD'a and 
medians and quartiles by cohort 



random sample of physicians, giving 
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Winning of Research Grants 

One final criterion is available ^ that of meeting conipetltlve standards 
with respect to applications for research grants • IWo government agencies* 
the National Institutes of Health and the National Science Foundation* made 
their award lists available on computer tape for matching with the NIGMS post- 
doctoral lists and the xanitm sample of physicians. The awards shown on these 
lists are the result of vigorous competition » in which applications for research 
grants are reviewed by committees of peers. Only a fraction of the applications 
are actually approved and funded » so the winning of such awards means the 
passing of a sever test of peer judgment. The results of this final quantita- 
tive test of merit are shown in Table* 10» where the NIGMS postdoctorals and the 
random sample of physicians are compared in terms of the percentage of each 
group who have won such competitive research grants. Figure 7 presents these 
data graphically. The difference between the NIQIS postdoctorals and the 
random sample of physicians increases progressively and sharply. 



TABLE 10 

Mean Number of Research Grants Awarded » NIGMS Post-MD*s and Random Sample of 
Physicians* by Cohort 



Comparison 
Group 




Total All 
Cohorts 




Cohort of MD Degree: 




?re-1958 
and Unk. 


1958-60 


1961-63 


1964-66 


1967-70 


NIGMS 


N 


4»312 


1.446 


871 


926 


760 


309 


Post-MD'a 


Mean 


.207 


.365 


.249 


.122 


.048 


.003 


Random Sample 


N 


14,933 


887 


2,827 


3,224 


3.2;0 


4,755 


of Physicians 


Mean 


.020 


.051 


.045 


.016 


.008 


.009 



Table 10 and Figure 7 show quite clearly that the mean number of research 
grants awarded is in line with other evidence regarding the relationship 
of the postdoctoral training to research activity. On the whole* including all 
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FIGURE 7 

Mean Number pf Research Grants Awarded, NIGMS Post-MD's and Random Sample 
of Physicians, by Cohort 
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MD cohorts t there were 207 awards per thousand NIGMS postdoctorals* as compared 
with 20 per thousand for the random sample of physicians. The increase In 
number of research grants with age is quite apparent also, rising from 3 per 
thousand for the most recent cohort to 365 for the pre-19S8 cohort of NIGMS 
post«»MD*s» and from 9 to 51 for the random sample, for the corresponding 
graduation cohorts. 

Summary Regarding Post->MD*8 

The career development lines and career achievements of the NIGMS post-MD*s 
have been examined, and compared with corresponding data for a random sample 
of physicians graduating in the same years from medical schools, to try to 
discover whether there is evidence that the objectives of the NIQIS postdoctoral 
program have been attained. These obj 'actives concern the development of 
medical researchers and the preparation of a more scientifically trained group 
of teachers for medical schools. The evidence examined concerns the propor-' 
tions who eventually become medical school faculty members, the ranks attained 
by those who do Join medical school faculties, and the research-orientation of 
the medical schools with which they affiliate. Another set of evidence con- 
cerns the relative contributions to the scientific literature, the extent to 
which these publications are cited by others, and finally, the proportions of 
the several groups who win research grants in the national competitions of the 
National Science Foundation and the National Institutes of Health • The evl-* 
dence from all these sources is quite cons is tent £ ^e proportion entering 
academic medicine is five times as great for the NIGMS post-MD*s as for the 
rand<»n sample of physicians; they advance more rapidly in more prestigious 
medical schools, they contribute more to the scientific literature, and the 
average value of their contributions is greater, as Judged by the number of 
times they are cited by other investigators. They win seven J^lmes as many 
research grants in the national competition. 

In short, by all the quantitative criteria which the committee could 
adduce, the post-*MD training programs appear to be attaining the objectives 
sought for the programs. The data suppo-t the interviews and the statements of 
individuals actually Involved in the prog-ams presented earlier in the report. 
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CHAPTER VI 



THE POST-PHD'S: CAREER PATTERNS 



The careers of PhD's, whether they take postdoctoral training or not. 
are vastly different from those of MD's. based on Initial differences in 
orientation and training. Typically, during their graduate education, they 
look forward to careers as teachers or as researchers, or as both combined. 
In Che present study, the data regarding the post-PhD's is also different 
from that of the post-MD's In large part because of the different data sources 
that were available— data banks that could be consulted without the expense 
and inconvenience to the persons involved of a special questionnaire. One of 
the differences from the study of the post-MD's concerns the quite different 
source of the comparison groups. 

As with the post-MD's. a random sample of PhD's was desired, covering 
approximately the same span of years of graduation as the postdoctorals them- 
selves. There was, fortunately, a readily available source in the Doctorate 
Records Pile maintained by the Office of Scientific Personnel. This file 
includes data about virtually all PhD's graduating from U.S. universities since 
1920. It was a simple matter to draw from this file a random 10% sample of 
science PhD's from the period 1954-1970. to be used as a basic comparison group. 
It was decided, however, to go further, and to select another sample, matching 
the NIGMS post-PhO's as nearly as possible with respect to field of speciali- 
sation, institution of PhD, year of graduation, and sex. This second sample 
was known as the "select sample", and it was expected that the data from this 
sample would resemble that for the postdoctorals much more closely than would 
that for the random sample. For both of these comparison groups, data were 
available with respect to their immediate post -graduation plans-i.e., whether 
they planned to enter postdoctoral training or Immediate employment. Previous 
research shows that this information is not only quite reliable, but also 
gives a good indication of probable career lines for several years after 
graduation. As will be seen, this datum was of crucial Importance in the data 
analyses. 



^ Mobility of PhD's: Before and After the Doctorate. (Washington, D.C.: 
National Academy of Sciences, 1971. Chapter V.) 
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Fortunately* there was available another substantial set of data — that 
concerning the postdoctorals supported by the National Science Foundation over 
the same period as those of the NIQfS program (1958**1970) . The NSF postdoctoral 
fellowship selection procedures were someidiat different than those used by the 
NIGMS» and» as it turned out upon examination of the relevant data, a signifi- 
cantly smaller proportion of the NSF applicants were awarded fellowships. This 
would be expected to result in a somewhat higher average level of quality of 
the awardees because when awards are made on the basis of merit alone (as they 
are in both of these programs) the higher the cut-point» the higher the pro- 
portion of the really outstanding students who will be selected. 

There was still another postdoctoral program whose awardees could be used 
as a comparison group, and, within this program, selection was even more 
rigorous than in the NSF program. That was the Postdoctoral Research Program 
sponsored by the Air Force Office of Scientific Research (AFOSR) • There was 
another difference between the AFOSR and NSF programs and the NIGMS program, 
one of field emphasis. Whereas the NIQIS program emphasized the biomedical 
fields, the other two were more general, and had, relatively, a much heavier 
emphasis on the physical sciences, engineering, and mathematics. All three 
programs, however, actually covered all fields of science, including the 
social sciences. Thus by controlling for field, it was possible to eliminate 
data biases due to the relative field emphases of the several programs. 

The decision on what field groups to use was relatively simple. Too much 
field fractionation would result In too many small fie Ids ^> making for confusion 
because of the numbers of comparisons needed and because of the relatively 
small sample size in each field, leading to large error estimates. The decision 
was to employ three field groups: (1) biosciences, (2) chemistry, and (3) all 
other fields combined. The latter group is very heterogeneous, and it is 
difficult to draw conclusions from It. It is included, however, for the sake of 
completeness, in order to show all the data. The major focus, for most of the 
comparison, however, will be on the biosciences, as this is the largest field 
group, and the one most central to the mission of the NIGMS. 
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The primary source of data on later careers of all the comparison groups 
was the 1970 National Register of Scientific and Technical Personnel. Tliis 
file, maintained by the National Science Foundation tor many years but discon- 
tinued after the 1970 registration, was maintained by voluntary cooperation, 
and provided data about the education, work experience, and current employment 
of all the persons included in the file. A very large proportion of all 
practicing scientists regularly completed this survey questionnaire. The re- 
sults were available for study purposes, with the stlplulatlon that data re- 
garding Individuals would not be divulged, and statistical results only be 
presented. This survey Indicated not only the field of specialization of each 
respondent, but also the category of employer and major on-the-job activity. 
Thus research, which is the primary objective of the postdoctoral tralneeship 
and fellowship programs of the NIGMS, could be sorted out from all other types 
of work activity, to see whether research is more frequently the major function 
of thos.. who have had postdoctoral training than of those who have not had such 
training. 

A further source of information, which provides data only on members of 
college and university faculties. Is the National Faculty Directory. This 
Directory, which seeks to be all-inclusive with respect to United States 
universities, and also includes some Canadian institutions, gives information 
only on the institution and department In which the individual is employed. 
(No information on field of speclaliEatlon or on-the-job function is available, 
for example.) vn.en added to the data from the 1970 National Register, however, 
it furnishes some information about those not there included. This Directory 
is published periodically In book form, hut computer tapes of the information 
m it were secured for the purposes of the present study, thus making possible 
n rapid and reasonably inexpensive source of information regarding those members 
of the comparison groups who were employed In higher education. Listing in the 
National Faculty Directory does not depend on individual cooperation, as the 
data were secured initially from college catalogs. The data tape used in the 
present study Included data referring primarily to 1970. although exact infor- 
."atlon on the time frame cover.d is not available due to varying reporting times 
ii. the basic source. 
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Career Outcomes of Comparison Groups 

One of the objectives of the NIGMS postdoctoral program was to prepare 
people for careers in research-oriented universities » as teachers or as 
researchers or^ more commonly » as persons who combined teaching and research 
in a productive way. But the program was not aimed solely at the academic 
world; many scientists pursue careers as researchers in industry » in govern- 
ment agencies^ and in non-profit organisations. It is important, therefore, 
to consider both the categories of enployers and the kinds of work activities 
to determine whether the NIGNS postdoctorals are performing in the ways intended 
by the program. The comparison groups provide some landmarks by which to 
Judge the degree to which these career outcomes are attained. Our attention 
will focus first on the categories of employers found by examining the data 
'*rom the National Register of Scientific and Technical Personnel. 

Career outcomes of the NIGMS postdoctorals and the various comparison 
groups in terms of employer categories and primary work activities for the 
PhD*s found in the National Register in 1970 are given in Table 11. At the 
bottom of the table, the number whose status is known (from the Register), 
the number and percentage whose status is unknown, and the total number in 
each comparison group is shown. This table includes all relevant doctoral 
fields. Figure 8 shows graphically the employer category data from Table 11. 

Taking the total of all fields and cohorts combined, and Including 
both sexes, as in Table 11 and Figure 8, it is apparent that for all the 
groups the primary employer category is that of colleges and universities, 
and that research is the primary work activity. For both trainees and fellows 
of the NIGMS postdoctoral program, university emplosrment characterises 77% 
to 79% of the groups, appreciably higher than for either the DRF random sample 
or DRF select sample, where the university employment percentages were 72% 
for both samples of those who took immediate postdoctorals, and 61% and ' 
63% for those who entered immediate employment after the PhD. (Some of the 
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FIOURh: 8 

Career Outcomes for Compariaon Groupst 1*>nployer Categories in 1970, as Pound 
in National Register, All Sciences and Cohorts, Both Sexes Combined 



Li^KND Colleges and Business and All Other 




Trainees Fellows Postdocts. Saployad Postdocts. rJmployed 



NIOMS Post-PhD's HHP Random Sample I)HP Select Sample 
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Utter groups prohahly held delayed postdoctoral appointments, but we have no data 
on this point.) The comparisons with the other postdoctoral groups show smaller 
differences, but ar*i in line with expectations based on the selectivity of the 
programs. The .\FOSR proRram drew iieavUy from J hose already academically- 
oriented, as sh.>vm by the fact that 957, of both the awardeea and the unsuccess- 
ful applicants are found on follow-up to be employed in academe. The ratio of 
applicants to awardees. as shown in Table 11, was 8:1. Probably, many of 
the non-awardee.. in the AFOSR competition received postdoctoral support else- 
where, but this information Is not available. For the NSF fellowship program, 
the percent In academic employment is very close to that for the NIRMS fellows, 
being 81% vs. 79S: for the M(;SM postdoctoral f-llows. The NSK selection 
ratio is more severe than that of the NICMS fellowship program, but both are 
selective on a national basis. Hy contrast, in the NUIMS traineeshlp program, 
selections are made locally according to the plans and purposes of each of 
the training programs, and no information on selection ratios is available. 



Primary Work Activity 

Data with respect to primary work activity are shown in the bottom 
portion of Table 11. It is appari-nt Uvrc that research I« the primary 
activity of the people of all the comparison -roups. Slightly over f>5'/. of 
both the NICMS fellows and trainees .„ o .-ngaged primarily in research, as 
compared with 667. for the DRF random sample postdocf.rals and 727 for the DRF 
select sample postdoctorals. These percentages are much greater than for the 
non-postdoctorals In either the random or select samples, where research 
occupied 407 and 467. respectively. .Among the AFOSR postdoctorals. research 
was the primary activity of 627 of .l,e awardees and 607 of the non-awardees. 
Of the NSF postdo-.torals. 62: are found in resoarch. The contrast, therefore, 
is between posidoc. orals and non-post doc. oral s . ra.hcr than anwng the various 
postdoctoral programs. 

A scmiewhat similar situation exi.sts with respect to teaching and other 
activity. The most marked contrasts are between the postdoctorals and those 
who entered employn^nt immodiately after the doctorate. For the latter gr.. .p. 
the teaching percentage was 37 for the rand.mi sample and 33' for the select 
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sample* while 23Z and 21% respectively of these groups were in kll other 
types of activity. The percentage primarily engaged In teaching » for the 
po8tdoctoral8» ranged from 22% for the select sample and 26% for the random 
sample, through 25% for the NIGMS trainees and 3C% for the NIGMS fellows to 
32% for the APOSR awardee&» 37% for the notk-awardees > and 34% for the NSF 
postdoctorals. The percentage engaged "primarily in other activity" was* 
for all of the postdoctoral groups* less than 10%--<*-le8s than half of that 
for the "immediate employment" groups. 

In summary » then* it is clear that insofar as the NIGMS posCQOctor::il 
programs were intended to produce researchers » they succeeded* their results 
being quite in line with those of other postdoctoral programs. The percentage 
in research reflects the relative degree of selectivity of the postdoctoral 
programs. Whether the NIGMS and/or other postdoctoral programs caused more 
people to choose research careers or whether they chiefly facilitated the 
training of those who were headed in that direction cannot be deduced from 
these data. In either case» the outcomes seem to be in accord with the 
program objectives. 

Bioscience Data 

The foregoing data were for all fields combined. The data for the 
biosclentistSt shown in Table 12» are very similar, but with uniformly higher 
percentages in university employment and in research, as compared with the 
total of all fields. Among the NIGMS trainees, 77% are in university employ*- 
ment, and 68% are engaged primarily m research. For the NIGMS fellows* the 
corresponding proportions are 84% and 68%. The NSF postdoctoral program 
shows data very similar to that for NIGMS — 78% in university employment and 
66% in research. The percentage employed by business and Industry goes up 
to 12*13% for the DRF select and random samples of "immediate employment" 
cases, where the proportion in "other activity" is, as with the total of all 
fields* over twice as high as for any of the postdoctoral groups^a minimum 
of 17% contrasted with a maximum of 8% for the NIGMS trainees and 4% for the 
NIGMS fellows. Figure 9 displays graphically the essential data regarding 
work activity shown In Table 12* One can summarize, without belaboring the 
statistical data, by saying that In the bioscience fields, even more than in 
the total of all fields, the NIGMS programs show outcomes In line with program 
objectives, and of about the same magnitude as comparable programs of other 
agencies . 
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FIGURE 9 

Career Outcoaes of Comparison Groups, as Found in 1970 National Register* Bioscience 
Fields, All Cohorts, Hen and Women Cmabined: Primary Work Activity 
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Kmployur Catcgorli\s and Postdoctoral Training 

Postdoctoral training in general, and training sponsored by the NICMS 
in particular, is intended to prepare people serve on the faculties of 
colleges and universities where a research orientation is important. It is 
not expected, of course, that all persons with this advanced training in 
research methodology will become faculty members. Some will serve in the 
laboratories of private industry and of government, and some will carry the 
skills and attitudes acquired during the postdoctoral experience into admin- 
istrative positions. Yet the major thrust of postdoctoral education is toward 
better preparati.m of teachers for the graduate sLhools. especially those 
who will be the mentors of PhD candidates. With tliis in mind, the data on 
19;0 employment of the NItiMS postdoetorals and comparison groups were 
examined with respect to the nature of the Institutions of employment of 
these groups. The categories used here group nonacademic employers into 
a single category, and classify Lhe academic Institutions according to level 
of highest degree granted. For the Ph.)-grant Sng institutions, the Roose- 
Andersen ratin^s^ are used for a further sub-division. The Roose-Andersen 
ratings used here average th.- university's bioscience department ratings, as 
departments of employment of the imlivldual were not known. 

Tahle IJ gives the data for the NICMS postdoctorals and comparison 
groups, all fields and cohorts cwihincd, and for the hioscientlsts separately. 
Tfie data for this table were derived (rwTi. tbe ll'atleral Rejilster of Scientific 
and Technical I'fersonnel for 1970. and the National Faculty Directory for the 
same year. In both sources. Inst lt,.t ion of employment was given; the academic 
institutions were ihen sub-sorted as described above, by level of highesc 
degree and by Roose-.\ndersen ratings. f)nly rw.. categor es of R-A ratings wore 
used for this purpose; abou. 40 fell in the "high" caie^.ory. and 607 in the 
low category. Pl,n-,.rant ing institutions for which no R-A ratings were avail- 
able were grouped with the mast ers-j.ranl schools into a single category. 
Those schools which grant baccalaureate degrees only consMiuted the fourth 
academic -employment category. 

6 

Kenneth I). Ruose and iJi.arle:; J. Anders, n, A l^it iiiu of Gradua, Pro^ranis, 
(Washington, J). C: Ann-ricau (.'..mux I I li.bn at 1 ..n . I'r/fj) 
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TABLE 13 

Categories of Institutions of Academic Employment in 1970. NIGMS Poatdoctorala and Comparison 
Groups. All Cohorts Combined 







NIGMS 






Samples from Doctorate Record Files 






Category 

of Institution 

of 1970 

Employment 




Fostdoctorais 


RandoD 


Select 


NSF 


AFOSR 




Train- 
ees 


Fel- 
lows 


Total 


Post 
Docs 


Empl 


Total 


Post 
Docs 


Gmpl 


Total 


Post 
Docs 


Post 
Docs 










A: 


Total of All 


Fields 












R-A Rating 
High 


N 

% 


364 
31.1 


435 
35.6 


799 
33.4 


326 
29.7 


992 
16.4 


1318 
18.4 


326 
32.4 


184 
20.1 


510 
26.5 


558 
45. 9 


(52) 
60.5 


R-A Rating 


N 

% 


358 
30.6 


421 
34.5 


779 
32.6 


360 
32.8 


2057 
34.0 


2417 
33.8 


316 
31.4 


280 
30.5 


596 
31.0 


382 
31.4 


(22) 
25.6 


MA Granting 
& Unrated 


N 
% 


303 
25.9 


253 
20.7 


556 
23*2 


241 
22.0 


1932 
31.9 


2173 


236 


297 
32.4 


533 
27.7 


197 
16.2 


(10) 
11.6 


lA Grant Ins 
Only 


N 

% 


146 
12.5 


i i ^ 

9.2 


10.8 


169 
15.4 


1073 
17.7 


1242 
17.4 


128 
12.7 


156 
17.0 


284 
14.8 


78 
6.4 


(2) 
2.3 


Academic Total 


N 

% 


1171 
80.8 


1222 
81.3 


2393 
81.0 


1096 
74.5 


6054 
69.0 


7150 
69.8 


1006 
75.1 


917 
68.7 


1923 
71.9 


1215 
83.7 


86 
96.6 


Non*Academlc 


N 

% 


279 
19.2 


281 
18.7 


560 
19.0 


376 
25.5 


2722 
31.0 


3098 
30.2 


333 
24.9 


417 
31.3 


750 
28.1 


236 
16.3 


(3) 
3.4 


Total Known 


N 

% 


1450 
60.8 


1503 
75.6 


29S3 
67.5 


1472 
65.3 


8776 
65.1 


10248 
65.2 


1339 
67.8 


1334 
66.6 


2673 
67.2 


1451 
73.7 


r9 

61.0 


Unknown 


N 

1 


934 
39.2 


486 
24.4 


1420 
32.5 


781 
34.7 


4696 
34.9 


5477 
34.8 


635 
32.2 


668 
33.4 


1303 
32.8 


519 
26.3. 


(57) 


Grand Total 


N 


2384 


1989 


4373 


2?S3 


13472 


15725 


1974 


2002 


397f! 


1970 


146 












R. Biosciences 












R-A Rating 
High 


N 

7 
»tt 


268 
31.3 


281 
38.0 


549 
3^.4 


125 
30.9 


179 
lb. 6 


304 
19.6 


227 
33.5 


134 
20.3 


361 
27.0 


119 
46.5 


(10) 


R*;. Rating 
Low 


N 

7, 


272 
31.8 


250 
3?. 8 


522 
32.7 


125 
30.9 


359 
31.3 


484 
31.2 


201 
29.6 


201 

30.5 


402 
30.0 


75 


(5) 


MA Craptln^ 
& Unrated 


-N 

% 


. 228 
26.7 


20.2 


377 
23.7 


93 
23.0 


398 
34.7 


491 
31.6 


162 
23.9 


218 
33.0 


380 
28.4 


(51) 
19.9 


(■») 


BA Granting 
Only 


N 

7. 


87 
10.2 


(59) 
8.0 


146 
9.2 


(62) 
15.3 


211 
18.4 


273 
17.6 


88 
13.0 


107 
16.2 


195 
14.6 


Ml) 
4.3 


0 




N 

7. 


853 
80.8 


739 
85.5 


1594 
82.9 


405 
73.8 


1147 
72.5 


1552 
72.8 


678 
76.6 


660 
74.3 


1338 
75.5 


256 
80.8 


(\B) 
100. 0 


Kon-Acadetnlc 


N 

1 


kL»3 

19.2 


125 
14.5 


328 
17.1 


144 
26.2 


435 
27.5 


579 
27.2 


207 
23.4 


228 
25.7 


435 
24.5 


(61) 
19.2 


0 

(18) 
64.3 


Total Known 


N 

% 


1058 
69.7 


864 

76.4 


1922" 
72.5 


~*549 
64.4 


" 1582 
68.9 


2131 
67.7 


885 
65.1 


888 
66.2 


1773 
65.6 


Tit" 

76.4 


Unknown 
Employinent 


N 

7. 


461 
30.3 


267 
23.6 


728 
27.5 


304 
35.6 


715 
31.1 


1019 
32.3 


475 
34.9 


453 
33. B 


928 
34.4 


98 
^3.6 . 


(10) 


Grand Total 


N 


1319 


1131 


2650 


853 


2297 


3150 


1360 


1341 


2701 


415 


(28) 



Percentages of academic and nnn-ac.identlc categories are based 
() Fewer than 75 cases. 

Percentages based on fewer than 20 casbR. 



on knnwn t nt :il . 
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The data for all cohorts are combined in Table 13, because tabulations 
by cohort had shown only very minor differences in the distributions of the 
various institutional categories, and the combined data, being based on a 
larger number of cases, are more reliable, making 4:he variations across the 
comparison groups more readily apparent. One cohort variation Is worth 
noting, however: The number of cases for whom no data are available Is higher 
for the most recent cohort, simply because the sources from which data were 
obtained he.d not yet been able to secure the necessary Information from the 
latest graduates. It takes a couple of years for the National Register to 
reach the normal percentage coverage of new PhD's. and. of course, many of 
these are still in postdoctoral training. 

In Table 13, the first four rows show data for the four academic 
institution categories described above. The percentages here are based on 
the total of the academically-employed. The percentages of academic and 
nonacademlc categories are based on the total for whom employment data are 

available. These, with the cases for whom no data are available, constitute 
the grand total figures on the bottom line of Table 13. The data from the 

first four percentage rows in Table 13 arc shown graphically in Figure 10. 

The data for the bloscient ists ..re not shown Kraphically. as they differed so 

little from the total of all fields as to be practically indistinguishable. 

Also, there were not enougl, case.s in the bioscience MUSR postdoctoral group 

to justify computation of percentages. The graphs, therefore, represent the 

total of all fields combined. 

Injlgure 10, the dat. for the four ins.r Untjotva c.-.ie«orJe. .^^e- plot ted 
for e.-ch of the comparison «.o.,p.s. .he hi^h-rated PhD-^rant in^ institution to 
the baccaUureate-grantiny institution constituting a profile for each of the 
comparison groups. Th*- ,our institutional categories are designated H (for 
high R-A ratings).!, ffor lower-ratin^ in.st I tutiuns) , M ^or masters-grantlng 
institutions) and B (for baccalaureate-granting institutions) from left to 
right across each profile. There i.. a rather clear familv resemblance among 
the profiles of the several postdoctoral ..ruups that di .st in«ui.shes them from 
the non-postdoctoral groups. Ihe ,,e.ner«l slope, t.-.r the po.s t doc? oral s, is 
downward from left to ri^ht . -he .steepness of ,he slope heim; related directly 
Lo the selectivity of the procedures .sod h, ...cb pr.MT.un. Kor the non-post- 
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doctorala. however, the curve is an inverted V, with the lower-rated or 
masters-granting institutions being at the apex, the high R-A rated PhD 
institutions always being relatively low in the percentage of the group's 
members. 

Again, the interpretation is relatively straight forward. The two NIGMS 
programs differ slightly in the direction to be expected by the relative 
selectivity of the trainee and fellowship programs. They compare favorably 
with the postdoctorals in both the random and select DRF samples, but are 
over-shadowed by the more selective NSF and AFOSR programs. The NIGMS 
postdoctorals clearly t-ntcr the faculties of the nation's PhU-granting 
institutions in numb ers in line with reasonable expectations and with the 
program objectives. The next question becomes the extent to which, in these 
institutions, they have contributed to producing the next generation of PhD 
scientists. 
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CHAPTER VII 
THE POST-^PHD*S: CAREER ACHIEVEMENTS 



Attainment of Thesis Adviser Status 



For the academical ly-employed^ one measure of career achievement that Is 
available Is attainment of the status of a thesis adviser in a PhD-gr anting 
university. The necessary data were obtained frcm the Thesis Advisers File in 
the Office of Scientific Personnel. This file was derived from the Doctorate 
Records File by virtue o£ the fact that each PhD since 1962 has been asked to 
name his thesis adviser. The names so obtained were combined into a single 
file and collated with the names of the people in the vc^rlous ccnnparison 
grouos. The percentage of each comparison group appearing in the Thesis 
Advisers File is thus a measure of the extent to which members of that group 
have attained this particular status in the academic world. Persons entering 
Industry or government or nonprofit organisations will not appear, 
unless at some time since 1962 they have also been in the academic world and 
have advised a successful PhD candidate. This percentage figure » then» is 
strictly a measure of academic attainment* but is certainly in line with the 
objectives of the NIQfS postdoctoral program. 

The data on thesis adviser status were examined for both the total of 
all fields combined* and for the biosciences separately* for the NIGMS post- 
doc torals and comparison groups* for the several graduation cohorts and for 
the total of all cohorts combined. If one looks simply at the totals for all 
cohorts combined* for postdoctorals and fit non^postdoctorals* an anomaly 
appears: The postdoctorals show up with a lower percentage than do the non- 
postdoctorals* while on a cohort-bycohort basis* the postdoctorals are clearly 
ahead. The anomaly arises from the fact that the percentage of PhD*8 re- 
ceiving postdoctoral fellowships has gone up strikingly over Lime* as noted in 
the Introductory chapter and in Figure 1 and Table 1. The postdoctorals* there- 
fore» ha^'e been PhO*s for a shorter timet on the average^ than have the non- 
postdoctorals and have had less opportunity to advance to the thesis adviser 
stage. Some means was needed to remove this inequity in order to suit the data 
for all cohorts into a single comprehonslble ^igure. 
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Thi- nu-ans used to equate for time since the PhD was to analyze each cohort 
separately, using as a norm the percentage of a random sample of PhD's who 
attain thesis adviser status In each cohort. This average base of 100% may be 
used to compare the various groups across a giver, cohort, and may also be used 
to sun the data across cohorts for the various groups. It has the advantage 
of rendering the lomparlson group differences on an easily-understood basis, 
as being above or beJow tlie norm by a given number of percentage points. If 
this percentage increases across the several cohorts for a particular group, 
tlien there is evi'lence of a cumulative effect of membership in that particular 
group. The norm for tlie average l»hD. of course, remains 100. The data are 
presented in Table U whiK- Figure 11 shows the bioscience data in graphic form. 

Table li shows the data for all fields combined in Part A. and for the 
biosciences in Part B. for each cohort (except 1967070, for which data were too 
sparse fur significant statistics) and for the combination of the four earlier 
cohorts. U is noteworthy that the postductorals , whether NICMS or other, 
tend to show up less favorably in the 1964-66 cohort. This is probably because 
they had one, two, or occasionally more years of postdoctoral experience before 
entering a faculty on a regular basis. Those who entered faculties directly 
after the doctorate had had more time to attain the.sis adviser status. However, 
after tne first l\w years, the postdoctoral experience seems to have a cumu- 
lative effect, increasing iron, cohort to cohort a,; rareers mature. Wl.ile not 
universally true, this nenera I f /.at icn holds with sufficient scope to he worthy 
of particular nuti'. 

The difference between Hie MCMS trainees and fellows shown Iq Table J4 
is probably a function of the selection of tie latter, who, like the NSP 
fellows with who.,, tlu-y are h.-re compare.', were carefully selected in a 
national .ompet i tion, and undouhtedlv had ability and environmental diiferences 
in their favor as .ompared with th.- trainees. It is known also, that fellows 
in far larger proportion cl.o.e academic- careers than did the trainees, larger 
proportion o. wl,..,:, ...tered non-a.adem i . and non-, er.eanh pusmons. The AI'OSK 
cases, ot who,:, tiu-re Ver. not enough cases i„ the hiosrie.Ues for a reliable 
co.:,parison, w.ro n.<.re l.i^^i.ly sele<ted u.an v/ere even I he NSI fellows, liu- 
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Kij»uri' 11 

Rolativi* alLaiiimi'ni Dt tJu'sis advlst-r status l»v NICMS pos t doc l orals 
and i-timparison gruupK, l)ic»si ii-tu fs onJv 
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applicant /awardees ratio being on the order of 8:1. Apparently » also, they 
were older at the time of selection, particularly in the early days of the 
program, so that some of them had already launched their academic careers 
prior to selection* Over 95% of the pre-»1967 AFOSR fellows and applicants 
entered academic employment on graduation. 
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Awarding of Research Grants 

Tlif award of competitive research grants by the National Science Foun- 
dation and the National Institutes of Health, as explained In the chapter 
on the post-MD'.s» can be considered a measure of career achievement* as It 
constitutes the pooled Judgwent of a jury of peers as to the merit of the 
researcli proposal. The data with respect Lj awards by these two apencies 
to post-FhD's are given in Table 15 and In Figure 12. for the total of all 
lields combined, by j'raduation cohort from 1958 through 1960, and for the 
total of all graduation cohort combined. As with the data on other measures 
of raretr progress or achievement, the differences among the several compar- 
ison >;roups are what one might well expect on the basUfe of selectivity. Tlie 
curves for the NSF and NIGMS postdoctoral fellows crlss-r.ross, and that for 
thf seltHt samplf of postdoctorals drawn from the Doctorate Records File is 
not far beliind. The curves for the NIGMS trainees and the random sample of 
postdoctorals from the DRF also cross, while the two groups of PliD's who 
entered limiiediate employment are at the bottom of the chart. 

One- anomaly appears in that the mean for tht- comb i nod 1958-1970 co»H»rts 
lor tlif DRF random sample of postdoctorals is iiiui:li lower than one would 
txpfct on LJie basis of the cohort means, lids is due quite simply to the 
heavy weij-hting of the most recent cohort, where there has not yet been 
eoou^ih time* [or tlu award of nuiny rcsearCl! grants. ' The number of postdoc- 
torals has grown qnitf rapidly, as discussed earlier, and this accounts for 
the heavy wi-Ighting of tlu- most recent cohort in the total for this group of 
postdoctorals. 

IL seiMns quite reasonable to conclude that thi>, set of data glve^ further 
evidence of the achievement of < areer r.oals quit., in line with ti,.- objective 
of the NIGMS program to produce high-q.l il i tv rese..n l, s. it-ntists, .is judged 
l»y th.- .riterion ol peer review of grant anpl ic.t iun . ii.ere rehain-; ..ne more 
-et ol data, whicl. refers more to the outcomes ..f the resi-arrl, ti.an t!:.- pro- 
posals, namely publications. This set of d.ita will .>t. reviewed n.-si . 
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mSLE 15 

Mean Number of Awards of Research Grants by NIH and NSF to NIGMS Postdoctorals and 
Comparison Groups, by Cohort, 1958-1970 



Cohort 
of 
PhD 
Graduation 


NIGMS Postdoctorals 
Trainees Fellows 


Samples 


from Doctorate Record 


Fields 


NSF 
Post 
Doctorals 


Random 


Select 


Post 
Doctorals 


Employed 


Post 
Doctorals 


Employed 


1958-60 


N 


275 


177 


152 


1669 


145 


248 


330 




Mean 


.447 


.779 


.467 


.170 


.731 


.362 


.815 


1961-63 


N 


496 


368 


351 


1909 


370 


395 


457 




Mean 


.370 


.701 


.404 


.138 


.524 


.245 


.549 


1964-66 


N 


562 


441 


525 


2643 


507 


443 


462 




Mean 


.334 


.392 


.230 


.089 


.386 


.221 


.519 


1967-70 


N 


727 


728 


1203 


5173 


939 


480 


452 




Mean 


.094 


.144 


.064 


.040* 


.112 


".068 ■ 


.219 


Total 


















1958-70 


N 


2060 


1714 


2231 


11394 


1961 


1566 


1701 




Mean 


.273 


.393 


.184 


.087 


.306 


.203 


.504 






i 















96 



79 

FIMIRE 1;! 



Moaa nu.:.vr o, awards of rosoarcl. grants to NK.MS postdoctoral s and cun.pari.-.on 
Kroups, bv cohort, 19:>8-1970 
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Publications and CiCations 

In all the considerations of the careers of the PhD postdoctorals up to 
this point, It has been clear that the car&er lines, or roles, of these pecple 
are not as clearly differentiated from these of non-postdoctorals as are the 
roles of the M> postdoctorals from those of MD's without postdoctoral training. 
In the case of the l»iD's, postdoctoral training has constituted an introduction 
to research technique, and a career shift from an almost exclusive a^votion to 
medical practical to research and academic medicine. For the JhD postdoctorals, 
the shift is less drastic - an upgrading of research skills, and, for some, 
shifts in direction of research. Bur the typical PhD is already oriented to 
res<>>arch, and expects to pursue an academic career in the majority of cases. 
The result is that the career outcomes or achievements of postdoctorals are not 
as clearly separated from a random sample of non-postdoctorals as is the case 
for the physicians. The consequences of this fact became most clearly apparent 
when the data on publications and citations were examined. 

The first step in the analysis of publications and citations was the same 
for the PhD's as for the physicians, i.e., all of the names occurring in the 
NIGMS fellowship and traineeship lists, all of the names in the Doctorate 
Records File, and all of the names of PhD's in the National Register Scientific 
and Technical Personnel were combined into a single file, eliminating overlapping 
memberships in the several groups. The result was a list of close to a half- 
million names that was matched with the ISI tapes mentioned above. This list was 
used to obtain publication and citation counts for all of these people, some of 
whom were NIGMS supported, and others of whom were sampled for development of 
ctmparison groups. The frequency with which duplicate names occurred in this 
half-million list was also noted. 

The result is shown graphically in Figures 13 and 14. (No data 
tables are provided, because - as will be reported shortly - it was 
decided to go on to a reiinement which, it was felt, would present the 
data more clearly.) Figures 13 and 14 present median publication and 
citation counts for the several comparison groups, with minimal break- 
out, for the biosciences and for chemistry. The data for the miscellaneous 
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FIGURE 13 



Median publication counts for NIGMS postdoctorals and comparison groups, by cohort. 
1958-1970, in two field groups 
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FIGURE 14 

Median citation counts for NIGMS postddctorals and conparlson groups, by cohort, 
1958-1970, In two field groups 

BIOSCIENCES CHEMISTRY 




Cohort 



ERIC 



100 



83 



"all other" group are omitted, as the purpose here is for general illustration 
only, showing a stage in the evolution of a procedure for data analysis. It 
is clear that there arc group differences, but the differences between the NSF 
and N1(;MS postdoctoral groups-probably based on different selection factors- 
were about as wide as the differences between the postdoctorals and the DRF 
samples. The latter samples are themselves quite clearly separated, again 
possiblv on the basis of initial differences in backgrounds, ability, and 



orientation. 



In the above publications and citations data there occurred people with 
name, that duplicated other names In the fi'o. As there was no way to distin- 
guish between them, the data for the two or more individuals were averaged. 
Although this was satisfactory as a preliminary step, it was decided that it 
would be wiser to exclude such ambiguous ca-.. altogether, and proceed with 
the unique names-those names wMch occurred .r.ly once in approximately a 
Imlf-miUion cases in the OSP file that was m-. • :hed with the computerized 
data from the Institute for Scientific Information. This results in the 
inclusion only of those cases where one could nave reasonable assurance that 
the counts were for the individual under consideration and not for someone 
else with the same name, or for a combination of the given Individual's works 
With those of another or several other p^.rsons. About one quarter of the 
oases wore those of multi-person names; the unique names comprised about Til 
of the file. ULlle the numbers of cases were cut down In the several groups, 
it was judged that the reduction in ambiguity ..f the data more than compen- 
sated fur the numbers. I;etails of this procedure are described in Appendix ». 

Another limitation of these data is the fact that further statistical 
analysis is almost precluded hv the statistics used. Medians are excellent 
for the purpose of portraying final results, and for interpretation of group 
differences in the case of skewed distributions such as are found with the 
publi.-.uions and citations data. ,iut they do not lend toemselves tu anv 
further analysis. The usual statistical techniques are designed to work with 
normal Iv-distributcd variables, and do not wurk well with highlv skewed dis- 
tributions, such as citation and publication counts. In order to perform 
further analyses using conventional techniques, it was necessarv. therefore. 



84 



to convert the raw counts to a nonoally distributed scale. The procedure 
used for this conversion is described in Appendix C. The results* expressed 
in standard scores, were then converted back to the original counts of publi- 
cations and citations for purposes of interpretation. This statistical route, 
through normalization and re-conversion, is important to keep in mind, as 
the results would be quantitatively different if the analyses had been made 
directly in terms of the original counts. The major effect of this conversion 
process is to reduce the importance of the cases with extremely high counts - 
analogous to reducing the effect of a few millionaires in calculation of 
average incomes of several groups of people. A small group with a single 
millionaire might thereby have its average Income doubled, masking the signi- 
ficance of the rest of the cases in the group. A similar effect in the 
publication and citation counts is avoided by the normalisation process. 
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Mean Publication Counts 

The publications data for the NIGMS postdoctorals and the several compar- 
ison groups were assembled in terms of the transmuted mean counts, as des- 
cribed above. These data must be considered on a cahort-by-cohort basis 
because, if the data for all graduation cohorts are considered together, the 
heavier weighting of the later cohorts in the postdoctoral data provides a 
serious d.'storti';g element, as the later graduates have, of course, had less 
time to publish than the earlier graduates. The data are also broken out by 
field, as there are important variations from field to field in publication 
practices. Only three field breaks appear Justified: biosciences, chemistry, 
and all other fields combined. The latter is an extremely heterogeneous 
group, including the physical sciences, mathematics, engineering, and the 
social sciences. Ilo^rever. none of these constituent groups is large enough 
for reliable data by itself. The combined data are, therefore, presented 
more for the sake of cornpleteness than for any clearly interpretable results. 

Table 16 provides che mean counts for each of the three fields described 
above, for each cohort, and for the total of all cohorts combined. There are 
eleven columns, representing the MGMS postdoctoral trainees, fellows, and the 
combination of the two; the random sample derived from the Doctorate Records 
File (DRF). sorted Into those planning postdoctoral training and those who did 
not. and the combined total; and corresponding data for the select sample drawn 
from the DRF to „uitch the NKiMS postdoctorals as nearly hs possible. Kindly, 
the two columns at the tar right represent ilu- d.ta for postdoctorals in two 
other government-sponsored programs: the National Science Foundation Postdoc- 
toral Research Program sponsored by the Air Force Office of Scientific Research. 
The latter program was very small in numbers, but the recipients were very 
highly selected. As a result, data are missing i„ many of the cells, but the 
total, for all cohorts combined are available. No data have been entered for 
cell means based on fewer than 20 oases; means bised on fever than 75 cases 
are entered in parentheses to Indicate that they arc not as reliably deter- 
mined as are the others. 
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TABLE 16 

Mean Number of Publicatlona for HtQfS Pestdeetorals and Conparison Croups, by Field and 
Cohort 







NIGMS 




Sauries from Doctorate Records File 














Random 


Select 


MSF 


AFOSR 


Field & 
Cohort 


Train- 
ees 


Fellows 


Total 


Post- 
Docs. 


Empl 


Total 


Post- 
Docs 


Empl 


Total 


Post- 
Docs 


Post- 
Docs 


Bioscience 
























Pre-19S8 


5.1 


13.4 






3.8 


3.9 




4.1 


4.3 


- 




1958-60 


5.7 


(7.9) 


6.> 


(7.9) 


4.5 


4.9 


6.7 


4.1 


5.0 


(9.7) 


- 


1961-63 


6.0 


7.6 


6.7 


7.1 


4.1 


4.9 


7.1 


4.2 


5.4 


(7.2) 


- 


•964-66 


5.9 


6.4 


6.0 


5.6 


3 2 


3.8 


6 1 


3.5 


4 7 


7.7 


m 


1967-70 


3.2 


3.6 


3.4 


2.9 


2.2 


2.5 


3.5 


2.3 


3.0 


4.7 


- 


Total All 
Years 


4.8 


6. 1 


5.4 


4.3 


3.3 


3.5 


4.9 


3.5 


4.1 


6.8 


8.0 


Chemistry 
























Pre-1958 




(18.0) 


(13.5) 


• 


2.8 


2.8 


• 


(3.7) 


(3.7) 


m 


m 


1958-60 


m 


(12.5) 


(9.8) 


(7.0) 


2.4 


2.9 


(8.1) 


(4.5) 


(6.0) 


(11.8) 


m 


1961-63 


(4.9) 


(7.5) 


6.7 


(5.3) 


3.0 


3.4 


5.3 


:3.8) 


4.8 


11.0 


m 


1964-66 


(6.5) 


6.8 


6.7 


4.3 


2.6 


3.0 


5.7 


(3.2) 


4.6 


8.7 




1967-70 


(2.9) 


4.3 


3.9 


3.4 


2.0 


2.4 


3.0 


(3.3) 


3.1 


(4.1) 


m 


Total All 
Years 


4.3 


6.7 


6.0 


4.1 


2.5 


2.8 


4.4 


3.6 


4.0 


8.1 


(9.4) 


All Other 
Fields 
























Pre-1958 


6.9 


(10.0) 


7.8 




1.5 


1.5 




(2.1) 


(2.2) 


4.3 




1958-60 


(7.7) 




7.4 


(4.8) 


1.9 


2.0 


m 


(2.7) 


(3.1) 


8.6 


m 


1961-63 


5.2 




5.5 


6.7 


1.8 


2.1 




(1.9) 


(3.3) 


7.1 


m 


1964-66 


5.1 


(5.1) 


5.1 


5.2 


1.9 


2.2 


(6.9) 


(1.8) 


(3.7) 


6.1 




1967-70 


2.5 


(1.9) 


2.3 


3.0 


l.l 


1.3 


(4.3) 


(1.7) 


2.5 


3.8 


m 


Total All 
Years 


5.4 


4.6 


5.1 


4.0 


1.5 


1.6 


6.4 


1.9 


2.9 


5.6 


(6.0) 



- Means based on fewer then 20 cases are omitted. 

() Means based on fewer than 75 cases are in parenthesis. 
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Taking the first columns of the bjcscience data, one can note that the 
mcMS fellows come out with generally higher mean publication counts than do 
the NICMS trainees, although in some instances the differences are not large. 
The same is true for the other fields, shown in the same columns farther down 
the page. However, the combined total for the NIGMS fellows and trainees is 
not reliably distinguished from the means for the other groups of postdoctoral. 
The NSF postdoctoral generally have higher mean counts than do the NIGMS post- 
doctorals. with a single exception in the heterogeneous "all other" tield. 
This is probably a matter of selection ratio; that is. a smaller proportion of 
the NSF applicants were awarded fellowships, and the resulting more severe 
competition probably resulted in an overall higher level of qualification of the 
awarders, what I, clearly apparent, however, is that the people who held post- 
doctorals are. with one Insignificant exception, higher in mean publication 
count« than are those who did not hold postdoctoral. This includes both 
those In the matching select sample and the random sample drawn from the 
Doctorate Records File. Among the non-postdoctorals. these two groups -.elect 
and random-are not always reliably distinguished from each other. 

The fact that postdoctoral, regardless of source of support, exceed the 
nonpostdoctorals, strongly suggests th.r the training, as such, was Important 
in causing the difference. However, there are important caveats in this regard 
especially in light of the fact that the more selective programs are generally ' 
related to higher scores. It could be, on the basis of the evidence up to this 
point, that all the difference, found are the result of .elective factors 
Before pursuing this qnestlcn further. It will be useful to view the correspondin 
data on citations, particularly because the citation data are generally regarded 
as more crucial than publication counts with respect to contributions to the 
hody of science. 



Mean Citation Counts for NlCMS and Comparison Groups 
The data on mean citation counts arc presented In Table 17, with columns and 
row. arranged exactly as in Table 16. The NIGMS fellows. In both blo.sclences and 
cher,l.stry. achieve higher mean citation counts than do the NiGMS trainees. The 
NIGM.S fellows are almost equal to the NSF fellows, in fa.rt exceeding the NSF 
average once (biosciences, I96A-1966). The average of the .NlGMS pustdoctorals 
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TABLn 17 

Mean Number of Citations for NIGMS Postdoctorals and Comparison Croups, by Field and 
Cohort 







NICMS 




Samples from Doctorate Records File 














Random 


Select 


NSF 


APOSR 


Field 
Cohort 


Train- 
ees 


Fe 1 1 ows 


Total 


Post- 
Oocs. 


hmpl 


Total 


Post- 
Oocs. 


Empl 


Total 


Post- 
Docs 


Post- 
Uocs 


Blosctcncii 
























Pre- 58 


31.5 


83.0 


59.0 


- 


14.7 


15.3 


- 


20.0 


22.0 






1958-60 


2A.3 


^41.0) 


29.5 


(54.0) 


11.0 


13.0 


44.0 


14.0 


22.0 






l%l-63 


22.0 


30.0 


25. 3 


21.5 


9.4 


12.0 


29.0 


12.2 


18.0 






1964-66 


14.7 


22.0 


17.0 


13.5 


4.4 


6.3 


17.0 


6.7 


11.2 




m 


1967-70 




4. 1 


3.2 


2.6 


1.5 


1.8 


3.5 


1.5 


2.7 


8.0 




Total All 
Years 


10.5 


17.0 


13.0 


7.3 


5.6 


6.0 


10.3 


7.9 


9.0 


20.5 


(46.0) 


Chemist ry 
























lYe-5« 




(130.0) 


(94.0) 




10.0 


10.0 




(15.0) 


(14.;) 






1958-60 


- 


(55.0) 


(44.0) 


(24.3) 


7.9 


9.2 


(40.0) 


(15.3) 


(25.3) 


(55.0) 




l9(>l-63 


n5.7) 


(24.3) 


21.0 


(11.2) 


1.1 


8.4 


14.7 


(8.4) 


12.5 


55.0 


- 


1964-66 


(10.5) 


16.0 


14.7 


7.7 


3.8 


4.9 


9.0 


(6.0) 


7.5 


24.3 




1967-70 


(2.8) 


4.5 


4.0 


2.7 


1.3 


1.7 


2.1 


(3.1) 


2.4 


(5.2) 


■ 


Total All 
Years 


8.4 


14.7 


13.0 


5.9 


4.6 


4.9 


6.5 


7.5 


6.9 


25 3 




All Other 
Fields 
























l'rc-58 




(52.5) 


29.0 




4.3 


4.3 


m 


(10.8) 


(11.2) 


' • 




1958-60 


(24. 0 




22.5 


(9.8) 


4.6 


4.8 




(8.4) 


(11.0) 


34.0 




1961-63 


i:<.5 




14.3 


15.0 


3.7 


4.3 




(2.7) 


r6.i) 


22.5 




196A-66 


11.0 


(6.7) 


10.0 


8.2 


2.5 


2.9 


(12.0) 


(2.3) 


(5.6) 


12.5 


tm 


1967-70 


2.1 


(1.0) 


1.6 


2.4 


1.0 


1.0 


(5.3) 


(1.1) 


2.1 


3.9 




Total All 
Years 


12.7 


6.7 


11.0 


5.0 


1.9 


2.1 


12.2 


3.7 


5.4 


12.5 


(13.5) 



Means hai>('(] on fewer than 20 cases aro omitted. 
() Means basi'cl on fewer than 75 cases are in parenthesis 



erIc 



106 

» 1 



St 

I 



howovor. Is ,u>l rclLblv Uistin^ulsluJ fron. th. two postdoctoral samples drawn 
from the. Doctor.to Rcvurds KiK.. TI.chc two latter groups, also, are nut 
..lw«vs ..U..,rly Jist InRuisI.eU fron, eacl. other, although both of them are nulte 
obvi..u.Iv higher in mean oltatlon counts th.n are th..se who entered emplovn.enl 
l..n,edl.,telv after «raduation. Thl.s findln, is similar to that tnr the mean 
IH'Miratlon oou.us and raises a«aln the cjuestion as to whether the pattern of 
Kreup differenees found is primarily a matter of the effects of training at the 
postdoeturai level, or of .n„l.., differences between the .roups that are related 
-Pn. It selection, or sH 1 -sel e.t ion to have the tralnln„ in the first place. 

'"'•-''i to the poH-lMl„v of .„ntrollIn« for 
tlH.se initial diff.renees. 1„ order that the effe.:,s of postdoctoral training 

rr>n the s.leetion faetors that detem.lne which 
pt-ople receive s.i.h trainlnv; and wUi.u do not. 

Deriving: Corrti ted M«an Counts 

n... ,,..„..r„l „,r.,..„y fur .orr.., !„,, ,„.. p„b„,,uo„ ,„,d citation ,„ 
all.- f„r tlK. JIff..r..„ti... ..rf..,.t.s „f ,„|t,., .MUty. ^,tlv.,tt..„. „„a „„d„,,.. 
.H.:l,„..l ..„.,r„„...„t ■„ t„ UnJ ».™„r..s th,,t .arr..,,,,.. with th... varl,.bl.« ,.„J 
w m, t,,.. p.„.„..a.o„K ...„u .u,.t..„s .,,,t.,. „v „.,„s „r ,. 

""■ - UK. .,H„„v ..„v.n,„«.„,..„ 

J..ta. ..„.. ,..„ ..»,,™.t.. h,™ „ .„ „u. v:,ri,.t t„.,t Is „l,„..rv..d l„ .„... t„ ,„.,„. 

.r..l„„„, „„.,,. l„,u Is. „„.. .,„.tr.,..t. ,„„ ... uu. ,u- „v .*t,,i,„,. s.„r.. tl,..t 

' ■"■'-•■•I r..s,.„.„ „y „„,..„ to 

'-"" '^ - - ■• This „tr..t..„.v r..,..ir..» .„.,t 

v.- fmJ v..rl,,h,... t„„t .ons.i.ut- r... ,hlv ..,.pr„«,„.a t„ th.. ..hili.v 

' '.„„.r. wis,, „. . ,i„,„,„.. r •Vorr..,...U 
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number of accidental environmental factors » all of which. hovever» predate the 
postdoctoral training. It was decided to try out this measure to see the extent 
to vhlch It correlated with publications and citations. 

It may well be that environmental differences related to the institution 
of PhD are li^rtant In Influencing publications and citations^ It may further 
be assumed that both aelf-^selectlon or choice of graduate school and selection 
by the graduate school on the basis of ability will relate to publications and 
subsequent citations of those publications. Attention thm turned to means for 
assessment of the graduate school environment that might be useful for the purpose 
of equating the postdoctoral and non-*postdoctoral groups so as to Isolate the 
Influence of the postdoctoral training from the selection and environmental 
correlates of graduate training. 

The best-known measure of graduate school environment Is the set of ratings 
deve. oped by Roose and Andersen of the American Council on Education^. The mean 
R-A rating for all the bioscience departments In each Institution was computed 
as we did not know the actual department In which each individual had received 
his graduate training^ although his field . of course^ was knowa. These average 
ratings were therefore included in the .analysis to determine whether they would 
help sharpen up the particular differences with which this study was concerned. 
It pfoved possible ft also^ to derive from the data of the study itself another 
set of environmental measures that It was throught might be more directly related 
to the question of subsequent publications and citations. These measures were 
derived through the following rationale (performed on transmuted standard scores g 
later re- Interpreted as publication or citation counts): 

(1) An Important part of the graduate school environment Is that furnished 
by the other graduate students. 

(2) We can measure empirically the propensity for these other students to 
"get into the scientific literature** via their publications and 
citations ft earned in the years subsequent to graduation. 

(3) By calculating the mean of the publication scores and citation scores 
of the bioscience PhD graduates of a given institution^ within a given 
field ft one can infer the nature of the graduate school environment in 
which any bioscience graduate student of the period had his training*— 
at least trie fellow-student portion of this milieu. 

Following this rationaleft the mean citation score and publication score was 
computed for all the bioscience graduates of the 1958-70 period in each of the 

^ Kenneth D. Roose and Charles J* Anderson» A Rating of Graduate Programs > 
(WashingtoUft D. C: American Council on Educatloni 1970). 
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institutions which awarded bioscience PhliVs during this period. Institutions 
having fewer than sixteen graduates for whom such mean scores were available 
were excluded, so that the resulting scores would not unduly reflect the influ- 
ence of a few exceptional individuals, who would in turn be characterized as in- 
fluenced by the environment which they themselves had created. The requirement 
of a minimum of sixteen cases largely avoided this circularity. IWo scores, it 
Is to be noted, are derived for each school in this manner - one based on the 
«ean publication score, the other on the mean citation score. Each PhD was then 
"Lagged" with these institutional indices for his own PhD institution. 

How was the influence of these measures, assumed to be possiblv influential 
m determining publications and citations, to be assessed? Four measures existed- 
vx) age at PhD graduation; (2) the average Roose -Andersen rating of the bio- 
science departments of the Institution of PhD; (3) the institutional mean publi- 
cation index; and (4) the institutional mean citation index. The assessment 
procedure was quite direct: Each individual in the bioscience PhD population 
of the 1958-70 period was assigned as independent variables the appropriate 
predictor scores (1) to (4) above and as dependent variables his own achievement 
scores (publications and citations). AH of the intercorrelations were com- 
puted, separately for each sex. and multiple regression equations were computed 
to predict the individual's publication and citation scores. 

Wliat the multiple regression equation does is to take inro account all of 
the variables used as predictors (in this case ago at PhD and the Institutional - 
environmental factors), and the inter-relations of these predictors, in influ- 
encing the outcome variable (publication and citation scores in this case). It 
turned out that age at PhD was indeed a valuable predictor of later publications 
and Citations, although not a strong one. The Rooso-Andersen ratings were even 
better predictors. The best predictors ..f all. however, were those derived from 
the later achievements of the graduate students themselves. In fact, these 
latter Indices performed in such a way as to subsume the effects of the R-A 
ratings, so that the final regression formulas - the onos with the greatest 
predictive signlfioance - included only the age at Ph,) and the relevant graduate 
student index. The mean publications index, in other words, was most important in 
predicting the individual's publications, and the mean citation index was most 
Important in predicting the Individual's citations. Because the regression 
equations were separately computed for men and for women, the sex differences 
both in the relationships between the variables and In average publications and 
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citations, are autcMBatically included in the fornulae. The actual regression 
fonnulae, and the specific details of this procedure are described in Appendix 
D. 

The exercise described above was undertaken to help highlight the influence 
of the postdoctoral experience Itself, apart from the influence of pre-existing 
conditions within the Individual or attributable to his prior experience. The 
result of the technique was to produce a "predicted citation score" and a "pre- 
dicted publication score" based on the coonbined Influence of the factors whioh 
it was desired to exclude. When this predicted score is subtracted from the 
actual score, one thereby removes, insofar as Is possible with the data at hand, 
the unwanted influences. The difference between the average of the residual 
scores (actual minus predicted) of those with and those without postdoctoral training 
shows the effect of the postdoctoral training, insofar as one can determine it. 
It is Important to note the inclusion in both of the statements above the qualifier 
"insofar as possible". One cannot remove the effects of abilities or environ- 
mental factors for idliich we have no measures, except insofar as they correlate 
with the measures which we do have. With this qualifier firmly in mind, we are 
ready to assess the effect of the postdoctoral training on the career outcome 
measures derived from the publication and citation counts. 
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Correctea Mean Counts for NlfiMS and Comparison Groups 

The corrected mean counts (actual minus predicted) for publications are 
given in Table 18 and for citations In Table 19. In both tables, data aru given 
for «ach graduation cohort separately, and for the total of all cohorts combined. 
In examining the data summed directly across all cohorts, it wan found that the 
effect of a rapidly increasing percentage of blosclentlsts taking postdoctoral 
trainins was producing a spurious effect. That is. the later cohorts, whose 
members had not had much time to publish, and even less time to be cited, are 
most heavily weighted in the postdoctoral group. The spurious effect, then, is 
to lower the summed postdoctoral publications and citations scores, as compared 
with the non-postdoctorals. who on the average had graduated earlier. The 
solution to this is to consider each cohort separately, and this is done in 
Figures 15 and 16. which show the corrected mean counts by cohort for the NICMS 
postdoctorals and the comparison groups. There is also shown on these two 
figures a kind of cohort average, derived from taking the unweighted average of 
the mean counts across all four graduation cohorts. These unweighted averages 
are given also In Tables 18 and 19. in the bottom line of each table. As can 
be seen by comparing with the scores for the 1958-70 group taken as a single 
cohort, these "cohort averages" are uniformly higher because thev do not reflect 
the heavier weighting of the later cohorts with loss time to get into the scien- 
tlflc literature, 

m Figures 15 and 16 there «e curves showing the "DRF Postdoctorals" and 
DRF I^edlate Employment" groups, with no separation of the randon, and s.le.-t 
samples. Tl,e data shown are the weighted averages of the two sets of data. The 
reason these two groups are not separated Is apparent In Tables 18 and 19. The 
two sets of scores, when corrected as described earlier, are too close together 
to „«ke separate plotting feasible, and in fact are seldom different bv a statis- 
tically significant amount, even though the numbers are quite l.,rge. »n the 
other hand, there Is a rather clear separation between the curves ,er those who 
have had postdoctoral training, whatever the source of support, from those who 
have not had such training. The NI«S curve crosses that of the DRF postdoctorals 
and that of the NSF postdoctorals again and again; the several curves are not 
reliably distinguished. The heavy dashed line ,„ Figures 15 and 16 represent 
the general average. I.e.. the mean expected score after the corrective factors 
have been applied. It Is weighted, of course, toward th. 
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TABLE 18 

Mean Publication Counts. Corrected for Ability and Graduate School Differences, 
for NIGMS and Comparison Bioscientists. by PhD Cohort 



PhD 
Cohort 


NIGMS 


Postdoctorals 


DRF 

Postdoctorals 


DRF 
Lmediate 
EnDloynent 


AFOSR 
Post- 
doctoral 


NSF 
Post- 
doctoral 


Trainees 


Fellows 


Total 


Random 


Select 


Random 


Select 


1958-60 


3.8 


4.5 


4.1 


(4.7) 


3.8 


2.9 


3.0 


m 


(4.9) 


1961-63 


3.7 


4.3 


3.9 


4.0 


4.1 


2.7 


2.6 




(3.7) 


1964-66 


3.3 


3.6 


3.5 


3.4 


3.7 


1.8 


2.0 




3.8 


1967-70 


1.7 


1.7 


1.7 


1.5 


1.8 


1.3 


1.6 




2.1 


1958-70* 


2.8 


2.9 


2.9 


2.4 


2.8 


1.8 


2.2 


(3.7) 


3.4 


Cohort 














2.3 




3.6 


Average*^ 


3.1 


3.4 


3.2 


3.2 


3.3 


2.1 





* The total 1958-70 cohort gives heavier weight to the larger, and more recent, 
cohorts. 

** Cohort Average Is the unweighted average of the cohort scores. 
() Parentheses denote means based on fewer than 75 cases. 
- Means based on fewer than 20 cases are omitted. 



more numerous recent cohorts; no cohort correction was applied. It is note- 
worthy that the actual^eicpected difference Increases progressively over tlme» 
l.e.i the effects of postdoctoral training are progress Ive-^- the investment 
pays increasing dividends as careers mature. 

In comparing the data of Tables 18 and 19 with the corresponding figures p 
it will be noted that in the latter the combined data for fellows and trainees 
are shown» whereas the data both separate and coxabined are given in the tables. 
The ''cohort average" data are shown in the Illustrations i at the far right g with 
the fellows and trainees distinguished. It is possible to distinguish some 
differences between these two groups, particularly in the early cohorts. This is 
probably because of selection differences that are not fully accounted for in 
the correction formulae. A hint of this is provided by the data for the NSF 
postdoctorals and that for the AFOSR cases also. These two groups, particularly 
the AFOSR postdoctorals, are very highly selected. Over a period of time these 
differences in selection rigor may be expected to have an effect, and the 
greatest effect, given sufficient time, in the citation counts, where quality 

differences count most heavily. 
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FlGURli 15 

Mean "corrected" publication counts for 
groups in bioscience fields, by cohort 



NIGMS postdoctorals and comparison 



in 

G 
O 
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u 
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u • 
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NSF Postdoctorals 



DRF Postdoctorals 



V NIGMS Postdoctorals 



DRF Immediate 
/ , ' Hmployment G 



oups 



General 
Aver.ige 



Cohort 
NSF -N.. Post. 



DRF Post. 
NIGMS T" Post. 



DRF 



Immediate 
Employment 



0 



2 Years 3 Years 8 Years 11 Years 
Average Number of Years Since PhD 



1967-70 
Cohort 



1964-66 
Cohort 



1961-63 
Cohort 



1958-60 
Cohort 
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TABLE x9 

Mean Citation Counts, Corrected for Ability and Graduate School Differences, for 
NIGMS and Comparison Bioscientists* by PhD Cohort 





NIGMS 


Postdoctorals 


DRF 

Postdoctorals 


DRF 
Iramediate 
Employment 


AFOSR 


NSF 


PhD 

Cohort 


Trainees 


Fellows 


Total 


Random 


Select 


Random Select 


Post- 
doctoral 


Post- 
doctoral 


1958-60 


15.0 


20.0 


16.7 


(28.0) 


(22.5) 


6.6 


9.4 




(25.8) 


1961-63 


12.7 


14.7 


13.5 


11.0 


14.3 


6.6 


6.9 




(12.2) 


1964-66 


8.0 


11.7 


9.4 


7.9 


9.8 


3.2 


3.8 




7.1 


1967-70 


1.5 


1.7 


1.6 


1.3 


1.6 


1.0 


1.1 




2.9 


1958-70* 


5.7 


6.5 


6.1 


4.0 


5.4 


2.7 


3.8 


(16.0) 


8.2 


Cohort 
Average** 


7.5 


9.6 


8.2 


8.2 


9.2 


3.7 


4.4 




9.4 



* The total 1958-70 cohort gives heavier weight to the larger* and more recent » 
cohorts • 

** Cohort Average Is the unweighted average of the cohort scores* 
0 Parentheses denote means based on fewer than 75 cases. 
- Means based on fewer than 20 cases are omitted. 



The above observations may be summed rather succinctly. They show that» 
over the period of time provided by these data* there are significant differences 
between postdoctorals and those who have not had postdoctoral training* with 
respect to both publications and citations* when all allowances possible from 
available data have been made for Initial differences between the groups. These 
differences Increase with time since graduation* so that we have only the be- 
ginnings of differences In achievements that may reasonably be expected to mount 
progressively as careers advance. The data also show* somewhat less clearly* 
that the allowances made by the correction formulae* while effective* are lm<» 
perfect* and that there remain some differences* as yet unanalyaable* in selec- 
tivity in the various groups. These selectivity differences* although minimized* 
still have some effect on ability to get into the scientific literature* and 
particularly to write papers that are most likely to be cited by other scientists. 
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FIGURE 16 

Mean "corrected" citation counts for*NIGMS postdoctorals and comparison 
groups in bioscience fields, by cohort 
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A Broader Context 

The foregoing data with respect to the career performance of the NIGMS 
postdoctorals and comparison groups appear to be rather consistent and reasonably 
definitive. That Is, the Influence of postdoctoral training, whether sponsored 
by the NIGMS or another agency, la clearly In line with the objectives of the 
sponsoring agencies. These objectives are to Increase the supply of highly 
qualified researchers, for both research and teaching functions* because It Is 
only those who are fully qualified in research who can teach the techniques and 
points of view essential for the advancement of science • The data indicate that 
the postdoctorals do more research than those without such training, that more 
of them are employed in academic positions, that they win more competitive research 
grants, that they contribute more to the scientific literature and that they are 
cited more frequently by their fellow scientists. The latter effects hold even 
when account is taken of the fact that they have initial advantages in terms of 
ability and environmental Influences. The comparison groups chosen for analysis 
of these effects show the results rather clearly. It was felt, however, that 
additional data might be very useful In providing a broader context in which to 
Interpret the findings, definitive though they might be with respect to the NIQfS 
postdoctoral programs. 

The broader context for interpretation of the effects of postdoctoral 
training was obtained by consideration of all bioscience postdoctorals, regard-* 
less of the mode of support, and coiiq»aring their performance and career lines 
with the iiAiole bioscience PhD population, using the same 1958-1970 PhD cohorts 
in the biosciences that have been referred to before in describing the correction 
process to discount the effects of selection for postdoctoral training. The 
full account of the findings of this more extensive survey are given in Appendix E. 
However, one of the highlights, showing the effect of postdoctoral training on 
citation counts, is given below. 

The career lines of postdoctorals and of the general bioscience PhD 
population were studied, and the Individuals were sorted out according to the 
major type of work performed and their institutions of employment in 1970, as 
shown in the National Register of Scientific and Technical Personnel. This 
had the effect of supplying another control variable - work context - to 
supplement the controls supplied by the "correction formula*' which reduced 
or eliminated the effect of ability and predoctoral environmental factors. 
Those in academic settings were sorted according to the Roose-Andersen rating 
averages for the bioscience departments. Those in institutions for which no 
Roose -Andersen ratings were available were sorted according to the highest level 
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of degr.... RrantcJ, a.,d the u„--au<l PhD-crantlng in.elt>,tlo„s uvrc conAlned fur 

this purpcs.. vltl, I. »...stcr»-Krantl„K InHtUutlons. In tliis way, the effect of 

major .y,..- ol work activity anJ typ^ of cployer .ir<. controlied, so that the 
difference between the postdoctarals and the general Phi. population «v be com- 
pared, as another way of measuring the effect of the postdoctoral experience. The 
data slvon in Figure 17 are for corrected citation counts, which eliminate. Insofar 
as possible, th.. ..ffecls of .ibility and graduate school environment. They include 

data for the 1958-h6 cohorts only, because members „f the most recent cohort had 
not had time for their publications to be cited. At the botton, of Figure 17, 
the citation counts (re-transmuted frnn the standard scores) are given. It U 
apparent that there are consistent differences, wider in the academlcallv-employed 
than 1„ the nonacademic groups, between the postdoctoral and the general norm, 
holding constant present e„,play.ent as well as ahlllty and predoctoral envlromnent. 

In Figure 17 the profile of citation counts by type of institution and by 
type of work activity within the postdoctoral group parallels the profile of the 
general bioscience PhD population, and Is of importance in itself. "Researcher," « 
regardless of background, obviously have higher citations counts, and "teachers"*' 
have l«,er citation counts than either the researchers or the mlscel Lineous "all 
other" groups. Those employed In research-orlenf c universities, particularlv 
the higher-rated instl.u, ions, score above those in the lower-rated and less ' 
research oriented universities and coH...... But the distinguishing features of 

the postdoctoral groups are „ost nanifest In the .-MSters-grant ing. bac.-alaureate- 
gr-mtlng, and no„-res,arch settings, u appears from this that, regardless of 
ultL^te e.,ploy™ent context, those who have had postdoctoral training are „ore 
likely to be cited rre,uently than are those without postdoctoral training. Put 
in another wav. the difference, within the several postdoctoral groups are sn^ller 
than Within the general population, and less affected hy the tvp. ol emplovmcnt. 
I1.IS Infornatio,,, combined with the fact that the postdoctoral vs. ge„er,.l popula- 
tion difference incr.-ases over time, leads one to the conclusion that the effects 
of such training on research output and .ontribut ions to science are ,„st beginning 
to be measured, and will in all likelihood he enhanced as ti»e go..s „„. The costs 
have been Incurred, but the benefits are only beginning to be felt at the presen,' 
time. 



Many 'Vesearchers" aNo toacU uml .w — n i i 

work .activities. These cattrl'l^ aJr-l^d e:'-, ^v-r.'i^tK.r^t^; 
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FIGURE 17 
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Comparison of correctedi citation counta of vostdoctoral bioacientiata and general 
bioanlence PhD population* by vork activity and inatitutlon type» average of 195B* 
1966 cohorts 



20^ 



u 



til 

9f 



s 



u 

s 



.Research 




Only 



BA Only 



Nonacadenic 
Population by 
Work Activity 



Academic Population 
by Work Activity 



Academic Population by 
Type of Institution 



14.3 9.1 18.7 11.2 14.0 19.0 15.7 12.4 10.3 Pdstdoc. 

9.4 5.7 13.8 5.3 7.3 14.7 10.3 5.9 3.4 Grand Total 

— — — — — Bioscience postdoct orals ^i"" " ' " General bioscience 

PhD population 



118 



CIIAPTI-K VI n 
SUMMARY AND CONCLUSIONS 



SMnoniit y 

This study was undc-rtaken at the requ>.st of the National Institute of 
General Mudical Sciences, to examine and evaluate the program of .os tdcn:tora 1 
training grants and fellowahIi>s sponsored by that institute over the period 
since 1958. Th^ objectives of the program were to improve the supply of highly- 
trained bloscientists and research-oriented physicians, to the end that the 
biomedical manpower trained In the nation's ,;edi.,\ schools and graduate 
schools might develop more scientific knowledge of medicine and'hen.e deliver 
better medical care to the nation's populace. The present studv was to 
concentrate on the effects of postdoctoral training on the careers of those 
who had been so sponsored; the institutional effects of training grants 
had been s .died by an earlier committee. 

The Committve sought evidence directly from former NIGMS postdoctorals 
and from present mentors and postdoctorals themselves, by conducting site 
visits to biomedical laboratories across the country. These Investigations 
showed that postdoctoral training furnishes the research orientation essential 
for physicians who will enter acaden.ic medicine, ami is increa.singlv required 
by the medical schools for the hiring of new faculty. It was found also that 
the opportunity for research-oriented Phl.'« and cl inical K-orlented phvslcians 
to receive postdoctoral training together is invalnnhl., ,„ extending the compe- 
tence and effectiveness of r.embers of both group., r.r the lM.i,Vs. opport- 
unity through postdoctoral training to sharpen research tools, i. incre..,. 
fU.xibIli,y. to allow for changes of field to meet new ch-.llenges. and to 
develop research Independence and confidence, i,. ...ssenti.U to tiu- be.t prepara- 
tlon tor teaching and research in strong graduate schools ..n.l labornorles . 
Those responding to the Cunanittee's inquiries, who have had the advantage of 
such training in the past, are unanimous with respect to its value. ..„d ,ec, 
that it should notlSe eliminated In f.vor of oth. r Methods o( support. Thev 
regard the flexIblUtv of the several node, of support as ..sen.ial to the .ost 
efficient operation of the r.-search and teachin,, . stai.l ish,:,ent . 

A set of cTperational criteria wore developed hv which ,o evaloae. in . 
quantitative manner, the career effects of postd.. t., ..1 training. Thes.. 
criteria Included (1) engagement in researC. as , pri.arv activitv. (», enplov- 
ment by medical schools .nd graduate schools, particu.arlv the rcscrch-.r iented 
institutions. (3) advancement up the academic l.uider In thcc institutions. 

1(11 
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(4) the winning of competitive awards of research grants offered by the 
National Science Foundation and the National Institutes of Health, and (5) 
contributions to the advancement of science ai ineasured by publications In 
the scientific literature and, particularly, by citations of one's publications 
by other scientists. 

To test the effectiveness of the program against each of these criteria, 
comparison groups were set up as standards against which the NIGMS trainees 
and fellows might be evaluated. For the po8t-M>*s, the comparison group was 
a random sample of physicians graduating over approximately the same period 
of time as those whose postdoctoral training was sponsored by the NIGMS. 
For the post»FhD*s, several comparison groups were drawn up: a random sample 
of PhD* s from approKlmately the same gradu«^tlon cohorts; a select sample from 
these cohorts, matched with the postdoctorals In terms of field of specialise 
atlon. Institution of doctorate, and sex; and two groups of postdoctorals 
sponsored by other agencies. 

The career patterns of the NIGMS fellows and trainees, and their career 
achievements as outlined above, were compared on all available dimensions 
with those of the members of the comparison groups. The results may be rather 
succinctly summarized: 

The FOst«MD*s 

Career Patterns : MD* who have taken NIGMS postdoctoral training are 
headed for careers In academic medicine and research, and achieve these 
career goals In numbers quite clearly In line with the objectives of the 
program that sponsored them. 

Career Achievements: Measures of career achievement show that NIGMS 
post-M)*8 obtain research grants In a competitive atmos^ere In numbers 
far beyond those of a random sample of physicians, become faculty 
members In the natlon*8 more prestigious medical schools » and rapidly 
advance up the academic ladder in this rigorously competitive environ* 
ment. The proportion of this group which publishes research papers is 
far larger than the corresponding proportion of a random sample of 
physicians; o;i the average|they publish far more papers, and are cited 
far more often by other scientists, Indicating significant contributions 
to the growth of science. 

Evaluation ; The medical schools, on the basis of experience, and 
through analysis of their own needs for highly qualified staff, have 
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turned increasingly to postdoctorals— both pes -MD's and j>i st-PhD*s, to 
fin their teaching and research positions. l..ey are highlv dependent 
upon people trained to this level for the advance of ,u».dtc.il science and 
practice. The opportunity to train MD's and P! D's tow. iher in j lesi-ar. M 
atmosphere, thu^ combining clinical and resi...r h appro...:!., s .n the aii.ia 
on medical problems, has become a keystone h the st.nuiur.. ... raf.Ji.aJ 
progress. 

The Post-PhD's 

Carei^at_t«-ns: Those who seek postdoctoral .rainluK dil'. « • ... . r 
career goals, motivations, graduate school eiivl t on.,u nt.s . .,r, . r 

terns from PhD's who do not seek posido..(oral traininti. l'.,std„c-,or.,Is in 
general, and the NIOMS postdoctorals as a particular Arou,., ,.IJ.«. mor» 
definitely research-oriented careers, and arv tound ....re ire.,u.,.tlv i.. 
academic institutions, than non-postdoci or.il l'i.,)'s. 

Ca reer Achievements : NICMS postdoctorals in academic Institutions 
attain thesis adviser status more rapldlv than du nun-posidu. .n.j 
are found with graater frequency in the mure ^.i ...ti«iou.s ,r.,.lu..,. .. .....1. 

and research-oriented nedlcal schools, fhev lar .«c.eeu th. u..-...,r... 
grant award rates of PhD's who have not had postdoctoral t:ai„inK. 

The most rigorous measures of research a. lu.'vement-immber 
publications and citations to these publ Icati-ns-uv, mrr- rxi,.,.- 
lively analyzed. Postdoctoral fellows tend to be l.u ,„o,. .nuduaiv. 
m these respects than those PhD's who go direct! . ...to employment 

This superiority Increases with time since the Phl>; this indicates 
that an even greater measure of contribution due ,u postdo-toral 
training is to be anticipated in the future. .are..s .uv ...:. . 

tven when allowances are made for individual dlf f.^ren. e- in 
ability (insofar as it could be estimated) and graduate school environ- 
ment, the superiority of the achievement of tie- postdoctorals was maln- 
tal,.ed. although diminished in degree. Vor most gr.-ups. the superioritv 
was maintained even when the ivpe .f emplover and prl.arv v.rk acilMty 
are also taken Into consideration. These results pr.vid.. str..,g .v........ 

for concluding that experiences a. postdoctura- i. ...... ... .r^.n... 

to produce superior researchers. 
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Within the several groups of postdoctor^ls^ there were dlfferencen 
that seemed to be related to the selectivity of the programs those in 
the programs in which the participants were selected in the most 
rigorous competition and by the most universal is tic criteria tended to 
excel over those in the less competitive programs. For example » NSF 
and AFOSR postdoctoral fellows attain thesis adviser status more rapidly 
than do those of the less c<»iipetitive NIGNS program. All of these groups » 
however^ exceed the attainments of the PhD*s who enter employment with- 
out postdoctoral training. 

Evaluat i o n: The MIGMS po8tdoctorals» both fellows and trainees^ followed 
career linest achieved career goals» and made scientific contributions 
clearly in line with the objectives of the NIGMS postdoctoral program. 
While no formal cost-benefit analyses were atteupted by the Committee^ it 
was noted that the whole NIGMS postdoctoral prograu could be paid for 
by an amount equal to about one penny per month for each of the country's 
wage-earners. The benefit to tax-paying wage earners is a question left 
for the reader to answer. 



Conclusions 

Research-oriented physicianst who have acquired the ability to apply the 
disciplines of basic research to the solutions of clinical problems, const itute 
an indispensable segment of our medical school faculties. It is only through 
them that the important discoveries that flow from the basic science labora- 
tories and from the clinical laboratories » can be interpreted to medical stu- 
dents and practicing physicians and thus applied for the benefit of mankind. 
There is no other group that can provide this important function. It is one 
of the most important functions of our medical schools if we are to envision 
future improvement in the quality of medical care delivered to our people. 

The faculties of our medical schools must be regarded as a most important 
national resource. The impact upon this total resource of cutting back tlu* 
medical school postdoctoral training programs could be disastrous within a 
relatively few years » because it would dry up the pool of young reuearcli-oriiMUo 
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physicians - those educated at the current frontiers of research. Only 
about 5% of all medical school graduates r.„d up as full-tim. academic faculty 
people and. of these, only a few can bo currently labeled as "research- 
oriented". Thus, the demand for postdoctoral MI) research training comes 
from a small, but very important, group of young physicians. Unlike the PhD 
the MD graduate has many avenues open to him besides the more difficult one of 
following a career in research. The extra opportunity and incentive provided 
by the postdoctoral program is thu. essential to maintain the flow of these 
key persons into academic medicine. 

Continued progress In basic and applied research In the biomedical 
sciences is based more upon the continuing supply of highly-trained manpower 
than upon any other single factor. Research In many areas of the biomedical 
sciences .^ay re,ulres a command of a broader ran^e of .cnowUdge and technl,ues 
than can normally be acquired In the course of doctoral education alone. IMs 
1= the result of a continued high rate of Increase of knowledge and the fact 
that many of the most important areas of research are at the margins of two or 
scientific disciplines. Thus, education beyond the doctorate is becoming 
. necessary condition for the accomplishment of hlgh-,uallty research In the 
biomedical areas, even by those „uh excellent graduate education. 

The rapid advances In the biomedical science. i„ th. last decade and a 
half have been facilitated by postdoctoral fellowship programs In a number of 
-ays. one of the most Important among them is uk- rapid diffusion of new 
ec nl,„es. Providing scientists with research opport;,nlties In the labora- 
tories of mternattenally eminent researchers is essential to diffusion of 

Furthermore the phenomenon of "critical mass" Is Important - the provision of 
Urge enough research groups of competent people of diverse sUUs and back- 
grounds so that their Interaction generates creative ac comp, t; post- 
doctorals contribute enthusiasm and fresh sHUs. as well as n^bers. o such 
groups. Pinally. these fellowship programs promote a healthv spirit of com! 
petition am«.g young American scientists and provide the mobUltv wh.rebv they 
r ach pos tion. where they can be most effective. Continued advances In' the 

1 h" I "»™ competition 

2 T T ""'""""^ ".e past. The 
discontinuation «,uld have very serious adverse effects on tl, 

biomedical science. 
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The result of greatly reducing the postdoctoral training of scientists 
holding the PhD would have adverse effects not only on the graduate depart- 
ments, but also on the medical schools. It is from this group that the 
majority of the faculty members of the preclinical departments of our medical 
schools are drawn. They cannot be effective] y replaced by scientists whose 
only research experience is the work of the:.x doctoral dissertation. It is 
through the postdoctoral training that the young scientist acquires the 
breadth and versatility that are absolutely necessary for high-quality teaching 
at the graduate level. The Committee concurs in the opinion of the biosden- 
tists contacted in the course of this study that a balanced program of support, 
including fellowships, traineeships, individual research grants, and institu- 
tional grants is essential to the continued improvement of the total system of 
science and practice essential to the nation's health. Although no data from 
actual experience could, of course, be adduced from the present study, the 
Committee believes that elimination of any single branch of the system of 
support of biomedical science, on the premise that it is less cost-effective 
than some other branch, would merely diminish the effectiveness of those areas 
that are to be maintained. The Committee reccnmends a balanced system, with 
gradual, rather than sudden changes in emphasis or program, and feels that a 
retention of fellowships and traineeships is essential to the future of the 
nation's health system. 

The impact of advanced research training on actual delivery of improved 
health care could not be examined by this committee. The belief in the impor- 
tance of such research training to health care delivery rests on the sound 
premise that better training results in better physicians. The direct measure- 
ment of this effect must await development of accepted measures of the 
quality of physician performance. This task was beyond the scope of the 
present committee. It is felt to be a matter of great importance, and one 
that should provide quantitative and objective evidence where at present the 
case must rest on the evidence of informed opinion. 
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APPENDIX A 



A Research-Orientation for Medical Schools 

In the absence of any nationally-recognized system for determination of 
the research-orientation of medical schools, a seal, was set up that Incor- 
porated elements that related most directly to the objectives of the present 
study. Published dnta were available regarding three quantitative measures 
for most of the medical schools. These three measures were combined in an 
arbitrarily^eighted system, with the weights arranged so that no single one 
would affect the rankings more heavily than the average of the other two 
The measures used, and their weights In the formula for this scale were as 
follows: percentage of the alumni who passed one or more U. S. Specialty 
Boards (weight - 1) jpercentage of the alumni who were later employed as medical 
school faculty (weight - 3); percentage of the whole student body who were 
graduate students or postdoctoral (weight -0.3). Inasmuch as these three 
factors wer. positively correlated, the weights might be changed somewhat with- 
out greatly altering the positions of the various medical schools in the re- 
sulting list. In any case, it is only the final grouping of the schools into 
six categories, rather than the exact position, that is significant, and it was 
the average across groups of schools that was used in the further statistical 
work, so that even the category into which a given school might fall would not 
have a profound weight in the final result. The several groups of schools, and 
the list of those for whom insufficient data were available for a determination, 
are given in Table A-1. 



107 



108 

Research-Otleatation Scale for Medical Schools 



Croup A; Score ■ 6 
Harvard, Qiicago, Johns Hopkins, Yale, Columbia 



Croup B; Score ■ 5 

Cornell, Rochester, Washington University (St. Louis), Hev York University, 
Vanderbllt, Duke, University of Pennsylvania, Case<-Westem Reserve, Stanford 



Group C; Score ■ 4 

University of Virginia, Bnory, Boston University, State University of Mew York 
at Syracuse, Wisconsin, Minnesota, Michigan, George Washington University, Uni- 
versity of California - San Francisco, State University of New York at Brooklyn^ 
Horthwestem, State University of New York at Buffalo, University of Washington 
(Seattle), TUlane, Vermont, University of California at ^-^s Angeles, University 
of Utah, university of Cincinnati, Elns -Yeshlva 



Group D; Score « 3 

University of Illinois, University of Iowa, Temple, Grfigr-Wake Forest, University 
of Southern California, Ttafts, St. Louis University, University of Maryland, 
Baylor, University of Oregon, Georgetown, Pittsburgh, Albany Medical Union, 
Jefferson Medical College, University of Colorado, Nodical College of Virginia, 
New York Medical College, University of Kansas, Marquette, University of Nebraska, 
University of Texas, Wajme State University, Ohio State University, University of 
Oklahoma, Medical College of South Carolina, Women*s Medical College (Pa.) 



Group E; Score - 2 

Indiana University, University of Louisville, University of Arkansas, Loyola, 
University of Puerto Rico, Hahnemann Medical College, Louisiana State University, 
Crelghton University, University of Tennessee, Chicago Medical School, University 
of Southwest Texas, University of Alabama, University of Mississippi 



Group F; Score ■ 1 

Medical College of Georgia, University of Missouri, Loma Linda University, Howard 

University, Meharry Medical College 



Unrated Schools 

University of Arlaeona, University of Calif orniS'-Davls, University of California- 
San Diego, University of Connecticut, Florida State School of Medicine, University 
of Florida, University of Miami, University of South Florida, Southern Illinois 
University, Rush Medical College, University of Kentucky, University of Massachusetts, 
University of North Carolina, University of North Dakota, University of South Dakota, 
West Virginia University, Dartmouth Medical School, University of Nevada School of 
Medicine, College of Medicine and Dentistry of New Jersey-Newark, College of Medi- 
cine and Dentistry of New Jersey-Rutgers, University of New Mexico, State University 
of New York at Stony Brook, Mount Sinai, Medical College of Ohio-Toledo, Texas 
Technological University-^Lubbock, University of Texas Medical Branch-^Galveston, 
University of Texas Medical School-*Houston, Eastern Virginia Medical School 
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I'ubH cation and Citation Counts as a Function of Name Frequency 

As mentioned In the main body of the report, it was found that It was 
possible to use with confidence the publication and citation counts only for 
those persons whose names appeared only once in the list compiled bv the 
Office of Scientific Personnel (OSP) that was matched with the computer tape 
from the Institute tor Scientific Information. This decision was made after 
an attempt to correct for the frequency with which a given name appeared in 
the OSP list, m the tabulations that were Initially made from th.- ISI tape, 
the counts for any given name were divided by the number of times that name 
appeared in the OSP file. That is. if j. j. jpnes appeared ten times in the 
OSP files, and the total publications count was 120. the number of publications 
credited to J. J. Jones was 12 - on the basis that we had no wav of knowing 
Which publications belonged to which Jones, and that an equal distribution 
among all the Joneses was the only equitable assignment. As the data were 
examined, however, it was found that this allotment of the many contributions 
by persons with the same name would add "more noise than signal" to the 
analysis, and It was decided to Include in the analysis only those whose names 
appeared once In the files. 

Tte distribution of publication counts for the persons In the file with 
unique na»e». and for those m,ose ns,ne, appeared two. three. „r »ore ll™e. are 
given ,„ Table BOl. Histogram Illustrating these distribution are provided In 
figure B-1. It is apparent that there Is a classical Uzy.j curve for the unique 
na« frequency distribution, and that this curve tends toward the normal for. a, 
na^. frequency Increases. U Is reasonable to assume that the count, provided 
In the unique „.,.e colu»„ are as nearly accurate as It Is possible to get fro» 
1.IS source, using the computer techniques that had to be employed for the eerv 
Urge number of cases Involved. Thus It appears that about 30". of the people ' 
have no publications during the period listed (l,bl and 19«4-;o,. However. 
the two-person names, there are only ,» „l,b „o publications. About half of 
those with no publications are therefore credited with ., publication bv someone 
else hav.ng the same „a^, and that person Is accordingly jot credUed with his 
own publication, by the "equal division- ..ocedure that war;mploved. Kor the 
hree-person names, the number with „ro publications falls to aboc. nz. and 
for those names appearing four or five times, the .ero- ,,-atIon count falls 
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TABLE B-1 

Percentage Distributions of Publication Counts as a Function of Name Frequency 



Number of 
Publications 


1 


2 


Name Frequency (in percentages) 
3 4 & 5 6 & 7 


8 & 9 


10 % & 
over 


0 


30.5 


14.2 


11.3 


7.3 


9.2 


4*2 


5.5 


• 

1 


14.4 


14.5 


16.3 


11.3 


14.7 


12.7 


7.6 


2 


10e4 


14.2 


14.3 


16.2 


16.8 


A a A 

21.8 


16.8 


3 


7.8 


10.9 


13.4 


12.2 


15.4 


15.7 


17.6 


4 


6.0 


8.7 


8.5 


14.2 


7,5 


M ff% 

7.3 


V A ^ 

18.7 


5 


4.7 


7e2 


7.6 


7.3 


6.8 


13.9 


14.5 


0 


3.8 


4.8 


5.4 


9.0 


9.6 


A e 

8.5 


e A 

5.3 


7 


3.3 


4.4 


3.9 


4.0 


3.4 


3.6 


5.5 


8 


2.6 


3.3 


3.8 


5.2 


3.1 


1.8 


A ■* 

3.7 


9 


1 A 

1.9 


2.7 


1.6 


2.9 


2.7 


« A 

1.8 


A J 

2.4 


10 


1.8 


2.2 


2.4 


1.4 


4.1 


3.6 


1.1 


11 


1.4 


1.5 




ie / 


e J 


.6 


1.1 


12 


a « 

1.4 


1.5 


.9 


1.4 


.7 






13 


1.0 


1.5 


1.1 


6 


1.0 


1.2 




lA 


1.0 


.9 


1.6 


.9 


1.0 


.6 




15 


.8 


.9 


1.6 


1.7 








16 


.7 


.9 


.7 


.2 


2.1 


1.2 


.3 


17 


.6 


.8 


m 


.5 








18 


.7 


.8 


.3 


.6 


.3 


.6 




19 


.5 


.3 


.1 


.3 


.3 






20-29 


2.9 


2.3 


1.8 


1.2 


.3 


.6 




30-39 


1.1 


1.0 


.1 


m 








40-49 


.4 


.3 


.1 




.3 






50-59 


.6 


.5 












Total Number 
of Cases 


11,616 


1.856 


761 


655 


292 


165 


380 
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FIGURE B-1 

Frequency distributions of publication counts by multiple name-frequency 
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to 7%. Thus, increasingly, the people with more common names who do not publish 
are credited with the publications of others with the same name who do publish, 
tn examining the distributions, it should be kept in mind that the exact per- 
centages are less and less reliable as the number of cases decreases from 11,616 
unique names to 1,856 two-person names, to 380 names appearing ten or more times. 
The general trend, however, is quite evident; the assignment at random of pub- 
lications to persons with common names adds random error to a rather clear-cut 
distribution curve that is highly skewed in its original form. As the random 
error increases with larger and larger numbers of persons with the same name, 
the distribution moves toward the "normal curve of error", as is to be expected. 
The decision was, therefore, to eliminate this source of random error, and to 
proceed with those counts that could be relied upon with greatest confidence - 
those for persons whose names appeared only once in the OSP files. 

Data regarding the citation distributions were similar in form, but even 
more highly skewed. These data are not presented here, but the form of the 
distribution curve may be observed from the raw count-to-standard score conver- 
sion table presented in Appendix C. 



Notes on citation counts and citation indexing: 

1. For a general review of the process of citation indexing, with bibliography, 
see Citation Indexes , by Melvin Weinstock, Institute for Scientific Information, 
35 Chestnut St., Philadelphia, Pa. 1&106, reprinted from Encyclopedia of 
Library and Information Science . Vol. 5, pages 16-AO, Marcel Dekker, N.Y. 1971. 

2. For studies of the validity of the citation index, see: 

a. A. E. Bayer and J. Folger, "Some Correlates of a Citation Measure of 
Productivity in Science," SocioloRy of Education . 39 (4), 382-390 (1966) 

b. S. Cole and J. R. Cole, "Scientific Output and Recognition: A Study In 
the Operation of the Reward System in Science,'* American SocioloRlcal 
Review . 32 (3). 377-390 (1967). 

c. J. Cole and S. Cole, "The Ortega Hypothesis," Science . 27 October 1972, 
pages 368-375. 
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APPENDIX C 



Converting Raw Publication and Citation Counts to Standard Scores 



The main body of the report refers briefly to the conversion of the 
original oublicatlon and citation counts to standard scores for the purpo^.. 
of statistical analysis. This appendix provides some more detail on the 
procedure by which this conversion, and the re-conversion back to publication 
and citation counts was made. The population used for this normalieation 
process (18,935 cases) consisted of all of the 1958-1970 bioscience PhD's 
with unique names, except those of foreign origin who either emigrated or 
who were uncertain of their plans to stay in the United States. 

Whenever one attempts to analyze highly skewed distributions, he must 
deal with the fact that our standard statistical tools are designed for vari- 
ables that are normally distributed. In many situations with only a minor 
degree of skew, the departure from normality can be ignored. In the present 
case, however, as shown in Appendix B, the skew is extreme and cannot be ig- 
nored without serious danger of distorting the final results. Frequently 
when skewed distributions such as this are encountered, recourse is had to 
the logarithms of the values, and means calculated on these logarithms. The 
result is a geometric mean, and that is quite understandable as such, m the 
present case, however. 30% of the cases had zero counts for publications and 
Citations. The logarithm of zero is indeterminate, and this alone renders the 
log conversion unacceptable. Accordingly, another method was chosen - that of 
converting to standard scores by the assumption that the standard tables re- 
lating percerciles to standard scores l„ the normal distribution will provide 
suitable values. The results suggest that this conversion process and the sub- 
sequent analyses provide meaningful data. For final interpretation of the 
standard score results, a re-conversion to publication and citation counts was 
»ade using the same table in reverse that was used for the original transmutation. 
The details of this process are described below. 

Figure C-1 on the following page shows the standard normal curve of dis- 
tribution. It is marked off in the familiar percentile terms - half of the 
cases fall below and half fall above the central point of the distribution, and 
the percentiles are spread out toward either tail of the distribution. Tl.i, 
normal distribution curve Is used here for conversion of the publications and 
citations counts. 
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FIGURE C-1 

The Normal Curve of Distribution for Converting Publication and Citation Counts 
to Percentiles and Standard Scores 
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The Standard Score Scale 



In the two lines below the percentile scale* the actual number of publica- 
tions and citations are entered to show the frequency with which they occur. 
Let us examine the publications scale first. Of all the scientists in the unique- 
name random sample, 30.5% had no publications of record. This is the largest 
single groupt and is indicated by diagonal shading on the curve. The mid-point 
of this group would of course be at about the 15th percentile, so zero Is entered 
at this point on the scale for actual number of publications. Next, a zone for 
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the 14.43; with one publication 1» ,hown with vortical rulinR; It Is cc-ntcrud 
abovo the 3811, percentile point. The .one for two publlcation„ l.s centered on 
the 50th percentile, or median. Beyond thU. the eones are not shaded, but are 
marked oft to Incldate the rel«lo.«hlp of percentiles to nu«ber of publication,, 
up to five. Fro« thU point on. the .ones are too narrow for graphic Illustra- 
tion, but follow the so« logic, and one can see that about 90Z had fewer than 
a dozen publications, and only one in a hundred had over 35 publications. 

The same set of step. Is used to convert from "raw" citation counts to 
citation percentiles. It Is noteworthy here that, although the zero point and 
single citation point are at nearly the same positions as the corresponding 
points for the publication counts, the scale from there on up„„rd is much more 
compressed. Ten publications and thirty-five citations fall at about the same 
point (86th percentile). twent,-two publications and one hundred citations fall 
at about the 96th percentile! while thirty-four publication. - 2,0 citations - 
98.5 percentile. The Interpretation Is clear: few people were cited In the 
scientific literature during the decade 1961-1970 who had not published during 
that decade. There are exceptions, of course-Aristotle Is still cited 
occaslonally-but the exceptions seem to prove the rule. Por the great bulk of 
cases. ,n numbers quite sufficient for statistical analysis, citation frequency 
goes up more rapidly tl«n publications. The correlation between the two count, 
(described elsewhere In this report) shows that the peopie wl.„ publish most 
are not only cited most often, but their ratio of citations to puhMcations is ' 
higher than that of those who publish infrequently. Again, ther. ar.- exceptions, 
but the general tendency Is quite clear. 

Standard Score Scale 
>.>e normalization process referred to earlier involves use ot the bottom 
scale, marked Standard Score Scale (frequently abbreviated to S.S). This scale 
» based on the arbitrary designation of the mean as 500 and the standard 
deviation as 100. The scale thus provld.^ is famiiiar to n.nv .hrourf. u. use 
With a number of standardized tests, such as the Graduate kecord Kxamination. 
one can. using these scales, convert from raw score to percentile to standard 
Hcore. T1.e raw score-to-percentl le transformation is an empirical one, the 
second step Is based on standard statistical tables. The result, omitting 
the intermediate percentile step, results In a conversion scheme .hich Is fed 
into the computer, so that henceforth In the analytical steps ,,„.. deals with 
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standard scores. The conversion cable is presented in Table C-1. For inter- 
pretation of the significance of final results* one can re-convert any given 
standard score to the original count to arrive at an average number of publi- 
cations or citations for any group - always remeotbering the statistical route 
by which such a mean was in fact derived. 
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TABLE C-1 

T.bl. for converting PubUc.tlon .nd Citation Counts to Standard Score,. 



IrublicatiODB 
Count as 



0 
1 
2 
3 
4 

5 
6 

7 

a 

9 

10 

11 

12 
13 
14 

15 
16 

17 
Id 

19 

20 
21 
22 
23 
24 

25 
26 

27 
2d 

29 

30 
31 
3? 
33 
34 

35 
36 
37 
3d 
39 



397 
468 
500 
523 
541 

556 
570 
561 
592 
600 

608 
616 

623 
630 
636 

64? 
64Ci 
653 
658 
663 

667 
671 
675 
679 
683 

687 
691 
695 
699 
702 

705 
708 
7U 
714 
717 

720 

723 
726 

729 
732 



PttbliOAtiOBO 


Count 

^wi*oo V 




40 


734 


41 


736 


42 


73a 




740 


44 




45 


744 


46 


746 


47 


748 


4d 


750 1 


49 


752 


50 


754 


51 


756 


52 


75a 


53 


760 


54 


762 


55 


7641 


56 


7661 


57 


7681 


5d 


770 1 


59 


7721 



60 
61 
62 
63 
64 

65 
66 

6*; 

68 
69 

70 
71 
72 
73 
74 

75 
76 
77 
78 

79 



774 
776 
778 

7ao 

782 1 

7841 

786 
7C8 
790 
792 

794 1 
7^61 
798 

doo 

802 

804 
806 
808 
810 
812 



For IHiblication counts over 79 
use: 812 + 2X PubllcaMons ' 



1 Citations 


1 Count SS 


1 ^ 


390 


1 1 


466 


1 ^ 


487 


1 1 

1 3 




1 




f 5 


519 


1 ^ 


527 


1 7 


534 


1 A 
I 0 


540 


1 0 

1 ' 


545 


10 


550 


11 


554 


12 


558, 




562 


1 A 

1 14 


566 




569 


16 


572 


17 


575 


18 


578 1 


19 


5ai 1 


20 


5d3 1 


21 


565 


22 


567 


23 


569 


24 


591 1 


25 


593 


26 


595 


27 


596 


28 


598 


29 


600 


30 


602 


31 


604 


32 


606 


33 


608 


34 


610 


35 


612 


36 


613 


37 


614 


38 


615 


39 


616 



Citations 
Count SS 



For highar cl 
>158<200: SS 
a200<300: SS 
^300<500: SS 
»500<1000: SS 
51000 : SS 



Citations 
Count SS 




057 


82 


658 


84 


659 


86 


660 


88 


661 


yu 




92 




94 


664 


96 


665 


98 


666 




667 


102 


666 


lOd 
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APPENDIX D 



Correction of Publication and Citation Scores for Environmental 
and Ability Differences Existing Prior to the PhD 



As mentioned in the main body of the report , the differences between 
the postdoctorals and chose not having postdoctoral training was found to 
be related to variables other than the training as such. It was also related 
to a measure of ability and/or motivation » and environmental differences 
existing in the predoctoral period. This appendix describes in somewhat more 
detail the procedures used to estimate the Influence of these correlated varia* 
bles and to eliminate their effect via the derivation of "corrected scores/* 
All of the statistical procedures described here were performed on the standard 
scores described in Appendix C. The final results tabulated in the body of 
the report were re^transformed back to the original publication and citation 
counts from the corrected standard scores derived as described below» using 
the standard score transformation table given in Appendix C. 

The statistical analyses were originally performed on the data for the 
two sexes separately* using a series of eight predictor variables for each de- 
pendent variable - publication standard score and citation standard score» re- 
spectively. As the data given in the following tables showi It was found that 
only two of these predictors were needed for each dependent variable « the rest 
contributed negligibly to prediction. Age at PhD came out in both regression 
formulae » but with a minor weight. It is assumed Co be a simple expression of 
a complex variable involving ability, motivation* and opportunity factors. For 
predicting the individual's publication standard score* the mean publication 
st> dard score (Pub SS M6an) for the individuisl's institution of PhD was the most 
valid predictor; for predicting citation standard score the corresponding institu- 
tional mean citation standard score (Cit SS Mean) was the most valid predictor. 
Both of these variables were derived from the publication and citation standard 
scores earned by the bioscience graduates of the several PhD-grantlng institutions. 
They therefore reflected a variable relating to the potentiality of the graduate 
student body at the respective institutions* and thus an environmental variable 
for any graduate student in biosciences in those institutions. Because no in- 
stitutional mean standard scores were used which were based on fewer than sixteen 
cases (many institutional means were based on over 100 cases) the individual's 
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lnflu..c. oo th. standard acre for hi, «« Inatleutlon „a. nagllglble. ih,.e 
l«tltutlo«l »an standard score, for pubU«tlons and citations are «lv«. In 

The eight predictors «ed In the regression «»lyse. «,re as follovas 

1. Age at PhD 

2. RAM (Rooae-Andersen Mean ratings for bioscience departments of the 
Institution from which the Individual graduated) 

3. Pub SS Mean (Mean publication standard score for the Institution 
of PhD) 

*. Clt SS Mean (Me«, citation score for the Institution of PhD) 

5. Clt SS/P„b SS Mean (Mean of th. ratio of citation .t««i.rd score to 
publication standard .core for the alu-nl of th. Institution of PhD) 

6. Pub SS SD (Stand«rd deviation of publication standard score for 
Institution) 

7. Clt SS SO (Standard deviation of citation st«,dard score for Instltu- 
tlon) 

8. Clt SS/Pub SS SD (Standard deviation of the ratios of citation stan- 
dard .core to publication .tandard score for the alu«nl. b, Institution) 

the ratio variable, as shown l„ th. regression tables, proved to be In- 
slsnlflcant. and have been ellnlnated. The standard deviation Indices also were 

IZ , '^'-*»-«"" "«e found to provide no additional 

val d varices beyond that furnished by the ln.,ltutl«..l publication standard 

m o" »" - out Of the regression fon.ula. 

The for»la finally used to provide each "corrected standard score" was as 
follows: 

Original Standard Score + 500 - Predicted Standard Score 
For the several predicted standard scores, the fomulae are as follows: 

Pub SS. Male: Age .t PhD x -a.- ^ p„, ss Mean x .10 . 7a.3l 

Pub SS, Female: Ace at PhD x - - a. « 

Clt sc: M 1 8 at PhD X - + Pub SS Mean x .06 + 152.98 

Clt SS. Male: Age at PhD x -1.09 + r^^ cc « 

^^^ ee I, , * Mean x .10 + 22.29 

Clt SS, Female: Age at PhD x - .55 + Cit SS M.f.n n, 

T oit SS Mean x .07 + 102.54 
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For Uioae who wish to study the detail of the statistical analysis,* 
Table D>2 provides the statistical constants for the four regressions; 
Table D-3 provides the intercorrelation tables for the publications, for 
nalea and females; Table D-4 provides the Intercorrelation tables for citations, 
for males and females. These are reporductions of the computer printouts, as 
are the four remaining tables, which give the step-wise development of the 
regressions. Table D-S gives the regression data for males on publications, 
Table D-6 for females on publications, TaUe D-7 for males on citations, and 
Table D-8 for females on citations. 
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TABLE D-1 

Institutional Mean Indices K^sed on Publication 
PhD^s Graduating 1958-1970 



and Citation Standard Scores of Bioscience 



Institution Name 



institutional 
Mean 

Bioicienc^ Pub Clt 



Phi 



ss ss 



Institution Name 



Institutional 
Mean 

Bioscience Pub Clt 
SS 



PhD* 



SS 



Alabama, Univ. of, Ala. 
Arizona State Univ., Arizona 
Arizona Univ. of, Arizona 
Arkansas » Univ. of, Ark. 
Auburn Univ. , Alabama 
Baylor University - Texas 
Boston Univ. , Mass. 
Hrandeis Univ., Mass. 
Brown Univ., R. i, 
Bryn Mawr College, Pa. 
Calif. Inst, of Tech., Cal. 
California, U. of, Berkeley 
California, Univ. of, Davis 
Calif., U. of, Los Angeles 
Calif. » U. oi. Riverside 
Calif., U. of, San Diego 

Calif., U. of, Santa Barbara 

Calif., U. of, San Francisco 

Case Western Reserve U. , Ohio 

Catholic U. of America, D. C. 

Chicago, Univ. of. 111. 

Cincinnati, Univ. of, Ohio 

City Uulv. of New York, N. Y. 

Clemson Univ., S. C. 

Colorado State Univ., Colo. 

Colorado, Univ. of, Colo. 

Columbia Univ. , N. Y. 

Connecticut, Univ. of. Conn. 

Cornell Univ., New York 

Delaware, Univ. of, Delaware 

Duke Univ., N. C. 

Emory Univ., Georgia 

Florida State Univ., Florida 

Florida, Univ. of, Florida 

Fordham Univ., N. Y. 

George Washington Univ., D. C. 

Georgetown Univ., D. C. 

Georgia, Univ. of, Ga. 

Hahnemann Med. CoU/Hos., Pa. 

Harvard Univ., Mass. 

Hawaii, Univ. of, Hawaii 



49 


533 


505 


22 


482 


468 


119 


506 


484 


29 


490 


477 


67 


506 


482 


67 


525 


497 


111 


300 


483 


65 


544 


561 


60 


531 


526 


18 


463 


460 


71 


562 


591 


722 


542 


542 


386 


552 


536 


426 


541 


530 


71 


508 


468 


44 


539 


520 


27 


514 


482 


87 


528 


520 


114 


534 


531 


87 


466 


467 


315 


546 


550 


91 


517 


495 


22 


543 


503 


18 


512 


480 


130 


510 


491 


109 


507 


513 


254 


534 


538 


137 


529 


501 


481 


541 


525 


49 


523 


508 


217 


529 


523 


69 


518 


514 


67 


517 


517 


148 


530 


520 


77 


497 


484 


109 


566 


559 


92 


548 


542 


n3 


518 


497 


40 


533 


518 


374 


551 


562 


70 


530 


508 



Howard Univ. , D. C. 
nUnolB Inst, of Tech., 111. 
Illinois, Univ. of, Til. 
Indiana Univ., Indiana 
Iowa State Univ., lowa 
Iowa, Univ. of, Iowa 

Johns Hopkins Univ., Md. 

Kansas St. U. of Ag&ApSc, Ka 

iCmsas, Univ. of, Kansas 

Kc>ntucky, Univ. of, Ky. 

Lehigh Univ., Pa. 

La. St. U. & Ag&Mech. Col., La 

Louisville, Univ. of, Ky. 

Loyola Univ., Illinois 

Marquette Univ., Wis. 

Maryland, Univ. of, Md. 

Mass. Inst, of Tech., Miss. 

Massachusetts, Univ. of, Mass, 

Miami, Univ. of, Florida 

Michigan State Univ., Mich. 

Michigan, Univ. of, Mich. 

Minnesota, Univ. of, Minn. 

Mississippi State Univ., Miss. 

Mississippi, Univ. of. Miss. 

Missouri, Univ. of, Columbia 

Montana Stale Univ., Montana 
Nebraska, Univ. of, Nubr. 
New Hampshire, Univ. of, N. H. 
New Mexico, Univ. of - N.M. 
New York Univ., New York 
N.C. State Univ., Raleigh 
North Carolina, Univ. of, N.C. 
North Dakota State Univ., N.n. 
North Dakota, Univ. of, N.D. 
Northwestern Univ. , 111. 
Notre Dame Univ., Ind. 
CKilo State Univ., Ohio 
Oklahoma State Univ., Okla. 
Oklahoma, Univ. of, Okla. 
Oregon State Univ., Ore. 
Oregon, Univ. of, Ori-. 



24 
30 
658 
231 
340 
228 
274 
n.l52 
211 
51 
16 
. 135 
55 
66 
52 
247 
91 
. 97 
76 
341 
A4« 
583 
37 
73 
152 
59 
IIH 
44 
16 
244 
176 
185 
26 
33 
155 
53 
398 
129 
169 
261 
101 



505 

494 

535 

519 

518 

532 

538 

522 

514 

533 

523 

509 

540 

534 

546 

525 

540 

522 

326 

526 

530 

159 

501 

548 

520 

510 

510 

523 

508 

536 

537 

503 

469 

538 

535 

496 

521 

504 

511 

514 

521 



476 

474 

5?.? 

513 

499 

513 

546 

502 

501 

487 

500 

496 

505 

497 

501 

521 

569 

487 

520 

513 

527 

536 

468 

5?7 

498 

503 

483 

503 

498 
525 
514 
493 
457 
514 
520 
498 
505 
494 
497 
499 
514 
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TABLE D-*l Continued 



Institutional 
Mean 







Pub 


Cit 


Institution Name 


No. 


SS 


SS 


Pennsylvania State Unlv.» Pa. 


216 


525 


508 


Pennsylvania* Univ. of> Pa. 


232 


546 


541 


Philadelphia Col. Phar&Scl.»Pa. 18 


552 




Pittsburgh, Univ. of» Pa. 


198 


519 


510 


Princeton Univ. , N» J. 


59 


539 

J mt 


553 


Kirdue Univ. , Ind. 


594 


517 


509 


Rhode Island, Univ. of* R. I. 


53 


507 


488 


Rice Univ. , Texas 


27 


513 




Rochester* Univ* of* N. Y. 


168 


537 


528 


Rockefeller Univ., Y. 


105 


587 


612 


Rutgers. The State Univ.. N^J. 


363 


519 


510 

JIM 


St. Bonaventure Univ., N.Y. 


22 


459 


439 


St. Johns Univ. , N.Y. 


57 


493 


458 


St. Louis Univ., Mo. 


76 


541 


516 


South Dakota* Univ. of* S.D. 


23 


521 


471 


So. California. Univ. of. Cal. 


133 


?32 


527 


Southern Illinois Univ. III. 




520 


A81 


Stanford Univ. , Cal. 


186 


S34 


528 


SUNY Col. at Svracuse. N.Y. 


17 


501 


486 


SUNY Med. Center Downst.. N.Y. 




570 


524 


SUNY at Buffalo. New York 


153 


539 


500 


SIINV MaH PfantAr Una tar A N.Y. 




557 


538 


Swacuse Univ.. N.Y. 


81 


51Q 




Temple Univ.. Pa. 


62 




51 A 


Tennessee. Univ. of. Tenn. 


159 




509 


Texas A & M Univ. * Texas 


178 


59 A 


^95 


Texas* Univ. of* Texas 


338 




59A 


Thomas Jefferson Unlv.» Pa. 


58 




HO J 


Tufts Univ. » Mass. 


43 


554 


5A9 


Tulane Univ. of La.* La. 


171 


526 


501 


Utah State U. Of Ag&ApSc. *Utah 


61 


519 


491 


Utah* Univ. of. Utah 


128 


522 


521 


Vanderbilt Univ.* Tenn. 


77 


520 


512 


Vt.» U. of, St. Agr. Col.* Vt. 


33 


509 


499 


Va. Coimionwealth U. Med., Va. 


37 


564 


507 


Virginia Polytech. Inst., Va. 


81 


508 


487 


Virginia* Univ. of, Va.* 


39 


478 


471 


Washington State Univ., Wash. 


116 


522 


504 


Washington Univ., Mo. 


73 


5?4 


508 


Washington, Univ. of. Wash. 


231 


543 


542 


Wayne State Univ., Mich. 


85 


526 


494 


West Virginia Univ., W. Va. 


98 


522 


492 


Wisconsin, Univ. of. Wis. 


874 


543 


538 


Wyoming, Univ. of, Wyo. 


33 


474 


445 


Yale University Conn. 


226 


546 


554 


Yeshiva Univ., New York 


27 


578 


557 
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TABLE D-2 



Statistical Constants for Regression Analyses of Bioscience PhD'i 



Variable 



Males 
N - 15.135 

Regression on Publications Standard Score 
Mean 



1. Publications SS 

2. Age at PhD 

3. Roose-Andersen Mean 

4. Publications SS l»fean 

5. Citations SS Mean 

6. Cit. SS/Pub. SS Mean 

7. Publications SS 3.D. 
0. Citations SS S.D. 

9. Cit. SS/Puh. SS S.D. 



537 
31 

290, 
5303. 
519A. 

986. 

920. 

928. 

139. 



.2 
.5 
,9 
2 
7 
9 
5 
6 
0 



SD 

93.4 
4.9 
74.9 
160.0 
221.0 
21.7 
82.0 
81.0 
10.0 



Mean 



490.0 
32.3 
295.3 
5302.7 
5217.6 
990.7 
919.3 
947.8 
139.6 



Ft-males 
N « 2,622 



SD 

83.8 
6.5 
77.8 
176.1 
233.6 
21.6 
76.3 
82.3 
10.7 



Regression on Citation Standard Sc 



ore 



1. Citations SS 

2. Age at PhD 

3. Roosc>Andersen Moan 

4. Publications SS Mean 

5. Citations SS ^tean 

6. Cit. SS/Pub. SS Mean 

7. Publications SS S.D. 

8. Citations SS S.D. 

9. Cit. SS/Pub. SS S.D. 



Mean 


SD 


524.7 


95.6 


31.5 


4.9 


290.9 


74.9 


5303.2 


160.0 


5194.7 


221.0 


986.9 


21.7 


920.5 


82.0 


928.6 


81.0 


139.0 


10.0 



Mean 


SD 


490.8 


92.4 


32.3 


6.5 


295.3 


77.8 


5302.7 


176.1 


5217.6 


233.6 


990.7 


21.6 


919.3 


76.3 


947.8 


82.3 


139.6 


10.7 
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APPENDIX E 



Broader Context for Interpretation of the Effects of Postdoctoral Training 
on the Career Lines and Career Achievements of Blosclentlsts 



The main portion of this report deals with the effects of NICMS post- 
doctoral training, and provides some comparison groups by means of which 
the effects of the fellowships and tralneeshlps may be evaluated. It was 
felt important, however, to look beyond the NIGMS programs alone, to seek 
to determine whether postdoctoral training, however supported, had Important 
career effects. The means for this broader outlook were provided by the 
procedures necessary for the study of the mGHS cases. As described In 
Appendixes C and D. the entire 1958-1970 bioscience PhD population was avail- 
able for analysis; all that was required was Information about their post- 
PhD careers. The first post-PhD datum was that provided by the Survey of 
Earned Doctorates /Doctorate Records File, regarding plans for the first year 
after graduation. 0:^^t data were provided by the 1970 National Register of 
Scientific and Technical Personnel, and by the 1970 National Faculty Directory. 
The coOblned data were analyzed to provide answers to stch questions as: 

1. What are the career streams upon which the NIGMS program Is Im- 
posed, and which in turn are modified by the NIGMS programs of 
support? 

2. How many people are Involved la these various patterns, including 
postdoctorals? 

3. What is the quantitative relationship between predoctoral and post- 
doctoral fellowship programs in the staffing of colleges and univer- 
sities? 

4. What are the quantitative relationships between career patterns or 
roles, and publication and citation acMevementa? 

For these analyses, the 1958-1970 PhD bioscler.tlst:s who were clearly idrn- 
tlfled by the "unique name" procedure described in Appendix B. were selected. Ex- 
cluded from the analysis were those PhD's of foreign origin who either went abroad 
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after .ompleiiun of tlu- FhO. or who were uncu-rtain as to th.lr po«idootoral 
plans (many of whom may be expected to have returned to their horn.- countries) 
n.i« left a population of 18,935 biosclentists who«e careers were analvaed In 
terms of the kinds of data that could be secured about them from the Doctorate 
Records File, the National Register, the National Faculty Directory, and the 
Institute for Scientific Information. T»,e career achievement data' for this 
analysis were limited to the corrected publication and citation standard 
scores for people pursuing various career lines. Because the data collected 
by the Doctorate Records File changed from time to time, all of the desired 
data were not available for the earliest cohorts. However, for the period 
1961-1970. there were a total of 16.191 bioscience PhD's for whom all the 
needed data were available, including important data regarding activity in 
the predoctoral year which provided a somewhat longer view of the career lines 
of these people. 



Career Lines of Biosclentlsu 

It was found, by sorting the new PhDVs by activity In tho predoctoral 
year that so«e of the career pattern, .hat later beca.^. Important were .learlv 
foreshadowed prior to the doctorate. „ „^ 

he graduates had been employed by con..„e., or universale- In faculty position, 
before the doctorate was earned. This „roup was already heavllv co»It.ed ,„ ' 
teachine-not esclusively. but In far larger prupor.Io. than were l-hl.'s „s „ 
-hole. Another important set of factors I„ u.at related to holding „. a pre- 
doctoral fellowship. AU those on fellowships. Iron, whoever source, were 
grouped and their subsequent careers analyzed. They. too. showed a dlrfer.n. 
pattern fro. Ph„.„ as a whole-one «re heavily .o^Uted to r..s..arch. ,., bring 
out and quantify these differences, the 16. l,, bioscience Phil's of the period 
rron ,,..-70. ,t,.e only years for whl, h the necessarv data were aval lab" , wL 
«.rted into three categories based on esperlence l„ ,he predoctoral year: those 
on felW-shlps. those working full-tlne In colleges or universities, and all 
others. Tl,e results are shown In Table K-, and KI„„re i:-I. Here M.e data I„r 
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the whole 1961-70 period are coiBblned» and both sexes Included, as only 
minor sex differences appeared in these data. (The data on predoctoral year 
experience and plans at PhD ware gathered from the Survey of Earned Doctorates, 
as mentioned above, while the data on employer categories in 1970 were 
obtained from the National Register and the National Faculty Directory.) 

Constancy of Career Patterns 

Table E*l and Figure E-1 show quite dramatically the constancy of career 
patterns over tine. At the left in both table and figure, the total of the 
16,191 bioscientists are broken out according to their principal activity in 
the year preceding the doctorate. Of the total, 34.4% held fellowships, 
14% were academically employed, and 51.6% were in all other categories. 
Progressing across the page, we find these three groups broken out by cate- 
gories of plans at the time of PhD graduation (middle of page), and finally, 
at the right, the categories of employment actually found on follow-up 
through the 1970 National Register of Scientific and Technical Personnel and 
the National Faculty Directory. 

Plans at the time of graduation tend to follow the actual fi.^tivity cate- 
gories of the predoctoral year. That is, of those on fellowships, the 
majority (51%) planned to continue with postdoctoral fellowships, trainee- 
ships, or other tjrpes of training. About 30% planned innediate a- ademic 
employment, and about 18% planned to enter nonacademic employment. Slightly 
over 1% were uncertain of their plans; this percentage goes up fractionally 
with the other groups. Of those who were already employed full time in 
academic work at the time of graduation, three quarters planned to continue 
such employment, 13% planned postdoctoral training, and only 11% planned 
nonacademic employment. For the rest of the graduates, with their various 
types of support during the predoctoral year, the percentages in the three 
categories of plans were nearly equal— roughly one third planned further 
training and a third each academic and nonacademic employment. 

Moving on to the actual employment in 1970, we note a continuation of 
the same patterns. Among the holders of predoctoral fellowships, academic 
employment is found for half of the cases, nonacademic employment for one 
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• ixth. ami for the r«»alnln8 third, actual «.ploj™„t could .^t be determined 
because the people could not be Identified In the available data banks. 
Turning to thoae who originally were employed In colleges and universities 
« see that 69% are still so e„ployed. while only 97. are employed In „on- 
academtc positions, and employment could not be determined tor 227. Finally 
for the "all other" category, we find academic employment for 48%. nonacademic 
employment for 22%. while for 31% employer category could not be determined. 

Another way of looking at the same data I, to consider the column 
percentages. That Is, Table E-1 shows that although fellowship holders con- 
stituted only 34% of the entire group, they constituted approximately half 
of those who went Into postdoctoral training, while t,.e 14% who were employed 
in academic positions In the predoctoral year constituted only 5% of the 
poetdoctoral fellows, oolng on t6 1970 employment, the division, are more 
nearly e,ual. but It 1. still apparent that the 14% employed In academe 1. 
the predoctoral year constituted 18. 7X of all those so employed In 1970. 
The data of Table E-1 and Figure t-l give only one of several possible 

ZT". °^ "•8^" P'-» at 

B.D and follow up to the data' available In 1970. Using the same 1961-70 

blosclentlsts. T.ble E-2 and Figure E-2 show data on the constancy of career 
i«tterns from this perspective. They l™llcate the extent to „h.. h plans at 
the time of graduation are an Indicator of actual career outco». m later 
years. Do Individuals catry out their plans, and continue In the same 
peeterns, or do career patterns change significantly In the period following 
the degree? * 
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In Table E-29 the top row gives the data for the total of all bioscience 
cases In the 1961-^70 group for whom data were available from the National 
Register regarding 1970 employment* There were 8|797 total cases in this 
group; of this total^ 5,924 (67%) were found to be in academic Jobs, and 
2»873 (33%) in nonacademlc Jobs. The academlcally-eioployed are further 
broken out into those primarily In research (32% of grand total), teaching 
(31%) and all other (5%). The nonacademlc 33% Is divided into those engaged 
primarily in research (22%) and all others. Each row of the table is simi- 
larly subdivided. The grand total shown in the top row is divided in the 
rows below according to plans at RiD: postdoctoral training (35?o) vs. Imme* 
diate employment (65%), in the second and third rows, respectively. Those 
planning Inmediate employment are divided into the academics (40%, row 4) 
and nonacademlc (25%, row 8). The plans for employment are then subdivided 
in the same way as the actual employment: the academics into research, 
teaching, and all other; the nonacademics into research and all other. The 
table thus permits a direct evaluation of the extent to which plans at PhD 
are translated ii!to the realities of employment several years later. 
Figure £-2 shc^ "le same data graphically: The top diagram shows the employ- 
ment outcome those who planned postdoctoral training; the middle diagram 
shows the e^ .^yment outcomes for those who planned academic employment; and 
the bottom diagram shows the outcomes for those who planned nonacademlc 
employment. Within each of these three diagrams, the total number of cases 
is shown, in percentage terms, broken into the same five categories of employ- 
ment as shown in Table £-2: academic research, teaching, and other; and non- 
academlc research and all other. 

The constancy of career patterns, or carry-over of plans into actions, is 
clearly visible in Table E-*2 and Figure E-2, in particular with respect to academic 
vs. nonacademlc employment. Of those planning academic employment, 89% are 
so employed, and 54% in teaching, primarily. Of those plannin*g nonacademlc 
employment, only 28% are later found In academe and only 13% in teaching. 
For this group, research in a nonacademlc setting employs 48%, other nonaca* 
demic work, 24%. Of the postdoctorals, who constitute the main focus of 
concern here, 727o are found in academic employment (527o in research and 177» 
in teaching) while the 28% in nonacademlc employment are divided 227. in 
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TABLE B-2 



nans at PhD 



Grand Total 



Fbst doctoral 
Training 



Innedlata 
Gmployment 



Grand 



N 8797 
H % 100.0 
V % 100.0 



N 3048 
H % 100.0 
V % 34.6 



Acadenic 
Bmployment 



Research 



Teaching 



N 


5749 


H % 


100.0 


V % 


65.4 


N 


3494 


H % 


100.0 


V % 


39.7 


N 


1266 


H % 


100.0 


V % 


14.4 


N 


1776 


H % 


100.0 


V % 


20.2 



1 Academic: 


Mon- Academic : 


Total 

Academic Research Teaching Other 


Total 1 
tlon- All 
Academic Research Other 1 


5924 2809 2703 412 
31.9 30.7 4.7 
100.0 100.0 100.0 100,0 


2873 1962 oil 1 
32:2 22.3 10.4 1 
100.0 100.0 100.0 1 


^1^5 1580 516 89 
ZliZ 51.8 16.9 2.9 
36.9 56.2 19.1 21.6 


863 678 185 1 
28^ 22.2 6.1 1 
30.0 34.6 20.3 | 


3739 1229 2187 323 
65^ 21.4 38.0 5.6 
63.1 43.8 80.9 78.4 


2010 1284 726 | 

22.3 12.6 
70.0 65.4 79.7 ( 



§9^ 
52.6 



Other 



N 

H % 
V % 



Non*Academic 
Employment 



Research 



N 

H % 

V % 

N 

H % 

V % 



452 
100.0 
5.1 

2255 
100.0 
25.6 

1394 
100.0 
15.8 



Other 



N 861 
H % 100.0 
V % 9.8 



1063 
64.0 
17.9 

1667 
93.9 
28.1 

387 
85.6 
6.5 

622 
27.6 
10.5 

265 
19.0 
4.5 

357 

6.0 



956 
27.; 
34. 



1892 
54.1 



647 
51.1 
23.0 

178 
10.0 
6.3 

131 
29.0 
4.7 

273 
12.1 
9.7 

141 
10.1 
5.0 

132 
15.3 
4.7 



320 
25.3 
11.8 

1388 
78.2 
51.4 

184 
40.7 
6.8 



269 
7.7 

C3.3 



377 
10.8 
13.1 



196 
5.6 
10.0 



96 1 
7.6 
23.31 

101 j 
5.7 
24. 5 1 

72! 
15.9 
17.5 



295 


54 


13.1 


2.4 


10.9 


13.1 


107 


17 


7.7 


1.2 


4.0 


4.1 


188 


37 


21.8 


4.3 


7.0 


9.0 



203 
16.0 
7.1 

109 
6.1 
3.8 

65 
14.4 
2.3 

1633 
72.4 
56.8 

1129 
81.0 
39.3 

504 
58.5 
17.5 



120 
9.5 
6.1 

48 
2.7 
2.4 

28 
6.2 
1.4 

1088 
48.2 
55.5 

852 
61.1 
43.4 

236 
27.4 
12.0 



181 

5.2 
19.9 



83 
6.6 
9.1 

61 
3.4 
6.7 

37 
8.2 
4.1 

545 
24.2 
59.8 

277 
19.9 
30.4 

268 
31.1 
29.4 



PhD's found in the 1970 National 
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PICURE E*2 

Actuai eaployRrat In 1970 for bioscience PhD*s» 1961-^1970 with varying plnns for ionodiatc poatdoetoral 
period 
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r«e.rch v.. 6X t„ all other type, ot «tlvlty. A..da.lc research, then I. 
th. «J.rtt, outc« for the poetdoctoreU. however ..pported. ith nonec.- 
de^e reeeareh 1« .ec«.d p«,itt.„ and te^htng. . prl«ty .ctivlty. third. 
All .o„.re,«irch ««I non-teachl,* actlvltle, co-prtae only n for the post- 
doctoral group, as c«p.red .1th 13% for the group planning .e.d«lc e.^lo,„nt 
and 27X for the group planning nonacadendc eoployaent. 

Do Later Jobs Accord with plans at PhD? 
The "Plan, at FhD" division, shown In Plg^e E-2 concern employer categorle. 
only. Table E-2. however, alao .h«„ the hreajcut. in ter-a of planned type of 
p«tdoctor.l activity. wUhln as^loyer category. data are portrayeT 

graphically m Plg„re g-3. xhe top»et dlagra, .how, the e.,Ioy«„t In i,70 of 
t ose Plying acad-nl. research: SIX are prl«rlly eng.gerinTe.e.Lh " 
1970. while 25% are engaged prl»arlly In teaching and 161 have left ac.de« 
going prl.«rlly into research In other settings. The second dlagr«. shows ' 
«.tco«s for those planning research career. In nonac.de-lc settings; 51% 
.re .0 engaged in 1970. .„d 20%. while In nonacade-lc «.ploy««,t. are m 
other than re.earch a. a primary activity. It .hould be not«i m all the.e 

now primarily in non-research work mav ai-iii a^a^^ 

wuiK may still be doing some research in a 

eecondar, capeclty. and those prl„rlly m research also do .«« teaching, 
we fli!!;"^a"! 7^°" 

we find that 787. are actually engaged prUarlly In teaching In 1970. while ,0% 
are primarily engaged In research. The three other categories of activity 
engage the re-elnlng 12%. divided al«„t evenly between "academe, other" and 
all type, of nonacademlc activity. Finally, the group, with plan, for other 
than re.earch or teaching a. a prl«ry activity are shown m the bottom two 
diagrams. «lthln these group., the .ettlng (academic or nonacademtc) remain, 
in accordance with plans for. the majority of cases. For work activity, this 
is not true; teaching and research are found to be the primary activities of 
the vast majority, with percentage distributions among the various types of 
activity roughly e,u.l for both the acad-.lc and nonacademlc plans group.. 
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nctms E*3 

AetuAl employment in 1970 for bioscience PhD*s. 1961-1970 with varying plans for immediate cmployecnt ac tha time 
•f PhP graduation 



PUns at PhD 
Thoae Planning Rcaearch: 

Acad«Bic 



Actual tciTloyment In 1970 



llonaeadcmic 



Thosa Planning Teaching: 



Academic 




Lb2 



), ^_ , — : : j 



Those Planning Other Than 
fteaearch or Teachings 

Academic 




Leper us 



Academic 
Research 



Acadcnic 



Academic 
OthiT 



Nunocadttmic 



Nonacad^mic 

Other 1hA:i Research 



Non-AcadcDic 
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Postdoctoral Training and Acadolc biployer Categorlaa 

Op to this point, we ha,. b.«. concerned with academic e.„loy«nt without 
differentiating the type of Inatltutlon. Tet there are l.portant variations, 
and theee varlatlona are related to the rea.«» for and need for poatdoct.rel 
training. Poatdoctoral training, including hut not Halted to that ,ponaor«l 
by the NIQMS. U intended prl-arlly to prepare people to serve on the facuUies 
of college, and unlversitie. where a reaearch orientation is ,„poru.t. There 
"111 be. a. we have seen «h1 aa postdoctoral aponsors ^ct. nonac.de.ic 
e-ployers .!.„. r„ ^ ^i^,. ^^^^^ ^^^^ n.nacd«.ic enployers 

of Institutions «r. ^ranged a. w«i d«,e earlier m the «in body of the 
report with respect to the co.parl.on group.. That 1.. they are .ort«i by 
Uvel of hlgheat degree granted, and the PhO-grantlng l«,el 1. .„b-.ort.d 
according to the Eoose-Andersen r.ting.. The rating. u.ed her. ccprlsed 
the .verage ratings of the bloscl«c. depart.ent.. a. the Individual dep.rt- 
.ent. of y^^, ^ ^^^^^^ ^ 

the bloaclence PhD', planning poatdoctoral tr.lning fro. all the other., 
and to ccpare the acd«ic and othar employer categorie, ., these poat- 
doctoral. with the norm of all bioscience PhB's. 

the /!? r.*""" for 

Of the. bio.cie.ti.t. who have had postdoctoral training. The cohort differ- 
«ce. are .mimal. except for the «,.t recent cohort, for which . larger p o- 
11 I T """""^ P.stdoctor.1 

Mrectory for the ye„. x, i^tu.,,on of enploymenl w« 

ven; the acadclc ln.tituti.ns were than sub-sorted a. dccribl .Tov .Z 
f L ■^..-Ander.en rating.. Only two categor e. 

biSh category. «.a 60. In the l« category. Ph^granting institutions for 
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TABLE E-3 

Employer Categories for All Bioscience PhO^s and Bioscience Postdocl:orals» by Cohort^ vith 
Comparison of 1958-1966 Postdoctorals and Non-Postdoctorals and Percentages of Postdoctorals 
by Employer Category and Cohort 









Knployer Category in 1970 










Total, All 


Academic Institutions 






Cohort Plans 














Non- 






Employer 












of PhD at PhD 




Categories 


K— n lUgn 




MA 


RA 


Ac ad enic 


UhknoMn 


Totals All Cohorts 
















All PhD*8 


N 


18,935 


2,061 


3,034 


3,102 


1,605 


3,531 


5,602 




% 


ion n 


10.9 


16.0 


16.4 


8.5 


1 A ft 




Pos tdoc tora 1 s 


N 


6^181 


991 


992 


726 


334 


930 


2,208 




% 


100.0 


16.0 


16.0 


11.7 


5.4 


15.0 


35.7 


1958*1960 


















All tlWl\ t ^ 

All rnu 8 


N 


: 2.7A4 










607 


675 




% 


100.0 


10.6 


18.5 


16.6 


7.5 


22.1 


24.6 


Postdoctorals 


N 


422 


64 






19 


67 


114 






100.0 


15.2 


21.1 


16.4 


4.5 


15.9 


27.0 


1961-1963 


















All rlUi 8 


N 


3.126 


356 


547 




256 


624 


791 




** 


1 100.0 


11.4 


17,5 


17.7 


8.2 


20.0 


25.3 


Postdoctorals 


N 


886 


157 


178 

A f O 




51 


137 


240 




% 


100.0 


17.7 


20.1 


13.9 


5.8 


15.5 


27.1 


1964*1966 


















All RiD*8 


N 


4,263 


^ A J 


801 

OVA 


801 
cm A 


346 


815 


987 




7. 


100.00 


a£ • U 


1ft A 

iQ. O 


Ifl ft 


8.1 


19.1 


23.2 


rOB cuoc cor a i s 


M 


1,356 


239 


282 


224 


76 1 221 


314 




% 


100.0 


17.6 


20.8 


16.5 


5.6 


16.3 


23.2 


1967*1970 


















All FhD*8 


N 


8,802 


900 


1.179 


1,293 


796 


1,485 


3,149 




% 


inn n 


10.2 


13.4 


14.7 


9.0 


16.9 


95.0 


Postdoctorals 


N 


3.517 


531 


443 


310 


188 


505 


1,540 




% 


100.0 


15.1 


12.6 


8.8 


5.3 


14.4 


43.8 


1958-1966 


















Postdoctorals 


M 


2,664 


460 


549 


416 


146 


425 


668 




% 


100.0 


17.2 


20.6 


15.6 


5.4 


15.9 


25.0 


Non* pos tdoc* 


















tarals 


N 


7,469 


701 


1,306 


1.393 


663 


1,621 


1.785 




% 


100.0 


9.3 


17.4 


18.6 


8.8 


21.7 


23.8 






Percentage of Total with Postdoctorals 






Total 
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1958-1960 
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1961-1963 
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34.0 


48.9 



U3 



Which „„ R.A rating. ».„ available we« grouped with th. »«tera grantiag 
.chool. l.t, a alngle category. Those achcl. «hlch grant baccalaureat. 
de8r«« only «».tltut«l the fourth acade.dc-eivloy™nt category. 

varied o^l, .Ughtly) tav. been coll.ct«l In t«o categorlaa - po.td.ctor.1. and 
n«.-poatdoctorala - to ahow «.t clearly the c.traat In «*l.yer categories „ 

1 L ««e large pro- 

portion of cases for .ho. data »ra Msalng. in the c.-.l..d 1,58.1,66 data 
a. for each of the flr.t three cohorta separately, it .111 .e noted that 1 
proportion In "high" Eoose^deraen rated schools 1. al«..t twice! wlhtr 
postdoctoral, aa for thoae without such training. PostdoctorU a rM" , 
. lightly Urger proportion ev«. m the "low" .«...-^ersen rated iL Zt\l 
^ n t he reaming categories the proportion of poatdoctoral. la slue ' 

rrnor'tT TT . ., 

««h portion of the graph la «d, proportional to the n«*.r of case. In thl 
K«.P - poatdoctoral. and non-poatdoctorala. At the botto. ot xZ g H. 

percentages of postdoctorala m a-^k ^ i * ® 

given. "octorals in each employer category, m each cohort, are 

Figure E-5, based on data at the bottom of Tabl« v ^ a 
dearly that the importance of nostd^. T demonstrates quite 

uvorcance of postdoctoral training to employment in th« 
«re advanced Inatltutlon. Increeaed .harply over the peril, mil, . The 
our ln.tltutlon.1 categoric, are clearly dl.tlng«l.hed at all lortT a^ 
for th. cohort average, shown at the right of the figure, ly ^ o 'th 
bloaclentlsts from the earlleat «h„,, i, ' 
T.t^ m.^ Mrlleat cohort who were. In 1,70. ei^loyed by hleh- 

rated PhB-grantlng Inatltutlon. had poatdoctoral tral.ln. «./ . 
"eadlly to S., for the .oat recent lohort. stuTT^j:':::^"; 
crease, are ahown for the lowar-rated PhD Instltutlo^. and ei^ f r tl 

~':hr c~h atT r -^'^-^ • 
.utiaticaiiy significan::;::::.: 'r:::iz ::r:rbVT " 

cohort, a. »entlon«i earlier. •valUble for this 



144 



FIGURE E-4 

Comparison of Employer Categories of Postdoctorals and Non-Postdoc- 
corals, bloadence PhD's of 1958-1966 
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FIGURE E-5 

Percentage of Bioscience Doctoral Faculty Me»bers with Postdoctoral Training, 
by Type of Employing Institution, by PhD Cohort 
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Summary Regarding Plans and Actual Employment 



A brief summary of the degree of agreement between plans for the first 
postdoctoral year and actual employment several years later, for the biosclen- 
tlsts eirnlng PhD's over the 1961-70 period is Chat by and large the plans 
are fulfilled, and that the passage of time changes career lines, but not 
drastically. Those planning academic careers follow them, and for the most 
part are found primarily in teaching several years later. Those planning 
nonacademlc careers stay for the most part in nonacadonic settings, and are 
engaged primarily in research. The postdoctorals wind up iMstly in academic 
positions, and, by about a 3>co-l majority, in research activity. The plans 
themselves tend to follow from activities in the predoctoral year: fellows 
tend to opt for more training; those already in academic positions remain in 
academe; while all others— that is, students otherwise supported<"-divide 
their plans almost equally between postdoctoral training, academic employment, 
and nonacademlc employment, but are found on follow-up to be primarily acade- 
mically employed, in institutions granting advanced degrees, and differentially 
in institutions with the higher Roose-Andersen ratings. 



nie descriptions, figures, and tables above describe employment outcomes. 
But what of career achievements? Is there any relationship between post- 
doctoral training, for this general group of bioscientlsts, and measures of 
success or effectiveness, as these were briefly outlined earlier? Do the 
postdoctorals contribute more than others to the scientific literature, in 
this broader sample? This appears to be the most central of all the questions 
that refer to career achievements, and it will be explored, both with respect 
to publications and citations, using the corrected standard scores described 
earlier. 



What of Career Achievements? 
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Publications and Citations of Bloaelentists 

The career line, of the blosdentists have given «,ide.c. of stronglv- 
dater-lned pattam. of a kind related to thoae found In the c«.p.ris.n group 
studies. The ,u.stion was whether these seM pattern, of achieveaent. as 
-ea,ur«l by publications and citations, would b, evldaa. for the whole bio- 
science population when those who pWd postdoctoral training i-ediately 

after the PhD were coapared with the .11 ^ 

«vma wicn Che aorm of all hlosclentlsta. In particular 

we wished to know whathar. c«u.id,rin8 the actual „ , J 

1970 the achievement pattern of postdoctoral, was different fro. the nor., 
to the data of isble ^4 we see that there is a difference (even after 
allowing for initial differance. in ability and environ»nt. as described 
earlier). Ihe blosdentists who planned i»ediate postdoctoral. co« out 
s^cad in al«st .11 of the co.p.ri.«,s with the general -.or.. A .u«„ry of 

m e,..i„i„g xaole ^4. it will be noticed that tl.e difference between 
the postdoctorsls snd the general nor. increase, over ti«; the eariieat cohort 
show, the greateat difference; the «..t recent shews practically no difference. 
In fact. «ny of the .^.t recent cohort have not had ti« since the PhD to 
.« any articles into print; the scores of all groups are 1«-. It was decided, 
therefor, to compute „ unweighted «erage acroa. the earlier cohort., which 
had had ti» to publish research papers. This unweighted average of the stan- 
dard .core, for each of the en^loyer category group.. .„„i^ „ros. the three 
aarlle,t cohort.. 1. .how., in the botto. pslr of rows In Table E-4. and 1. 

a .olid horlsontal line at stsndard score 517. The corresponding average for 
the postdoctoral. Is „ by . dashed horisontal line at stsndard score 534. 
Thus there i. .„ .verage difference, for these cohorts, of 17 standard .core 
points, after allowing, as the corrected scores do. for Initial abllUy and 
environmental differences. 
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FIGURE E-6 

Corrected publication standard scores for bioscience PhD's and postdoctorals. 
1958-1966, by categories of employment in 1970 
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The sharp differences displayed by the postdoctorals» shown In Figure E-6t 
are greater for the academic groups than for the nonacadaalc • Ails overall 
difference Is shown by the first pair of symbols: a circle with a line 
through It for the general academic norm» and an "x** with a dotted line 
through It for the academic postdoctorals* The difference Is 22 standard 
score points. In the next section of the charts all of the people» regard- 
less of employer category* who are doing research are compared with all 
those doing other types of work. The superiority of the postdoctorals In 
research Is reduced to seven points; those In non^reaearch actlvltes show 
a difference of 23 points. It seems probable that many of those who» In 
1970ft were not primarily engaged In research* had been promoted to adminis- 
trative positions; others were from the beginning primarily engaged In teach- 
ing. Going on to the third set of figures » or pair of profiles » we see the 
non-academic researchers compared with non-academic "others *\ The same 
pattern persists* but both groups are lower on the profile than are the groups 
that Include academicians. The third profile* consisting of three points* 
compares the postdoctoral and norm group academicians sorted Into those prl*- 
marlly engaged In research (no difference between the postdoctorals and the 
norm group)* teaching (with a 24-polnt advantage for the postdoctorals)* and 
"all other" (where the postdoctorals are 19 points ahead) . For those who are 
primarily research-oriented* the publication differential vanishes. Those 
postdoctorals who are teachers primarily are nevertheless well above the 
general norm on publications* while teachers as a whole are 12 points below 
the norm* 

The next profile in Figure E-6 compares the academic postdoctorals and 
the general bioscience academic population by category of institution type* 
for those cases found in the National Register of Scientific and Technical 
Personnel . This stipulation appears to be Important. The Register apparently 
picks up more of the research-oriented people; the publication standard scores 
of registrants are higher than those of people who do not enter the Register. 
The first point in this profile is for the institutions whose bioscience depart- 
ments rated high in the Roose-Andersen ratings. Within this select group* the 
postdoctorals actually ranked slightly below the general norm* but still above 
the score of any other group in Figure E-6. People who win appointments in the 
high-rated institutions without having had postdoctoral training are probably 
exceptional people. Turning to the lower-rated PhD-producing institutions* 
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« 

w. note that the .core of the generel ne» group drops f„ther th«. does 
that of the postdoctoralsj this difference 1, further enhanced when we go 
on to the -asters-grantlng ln.tltutl«,a. «»l 1. still greater »he« „e turn to 
the baccalaureate-only colleges. 

there i, .how. next In figure E-6 the group of bloaclentists «ho were 
located only through the National Faculty Mrectory, this group does not 
include those who «y aUo have been found m the Natlo^il «eglst«. "jiTre 
the postdoctoral group was too s«ll for reliable statistics. For the 
general bioscience popuUtlon. h«„v.r. the profile is so,»„hat similar to 

ter tet:: !" "■^T^*"' '-d In the National Regis- 

ter The high Roose-Andersen gr«.p scores al«st a. high, on the average. 
« does the Register group, for the low-rated 8oo.e-Ander,en group, and for 
the .^sters-grantlng schools, there Is a strong difference m favor of the 
Register group At the baccalaureate level, there 1. only an ln.lgnUlc«,t 
d ff rence. clearly, the differences between these two profiles reflect a 
greater research and publication, orientation on the part of those found In 
he Register Finally, .t the e«re« right of the page In Figure K-6 are 
the scores of those In both the postdoctoral and general bioscience popuUtlo„ 

ZZ\ r"'" ^""^^ scores a e » 

7ZT » '"^ -al-"i« a statistically 

significant superiority. 



Corrected Citation Standard Scores 



Tl.. difference between postdoctorals and the general nor- of blosclentlsts 

LIZ 'T'' """" " " - ' 

iTf^nL. \ ' parallel 

ITT '""^^^'^ ^or publications, but the general average 

o be clt«. than to have its papers published. As was the case for pub ca o 
the Citation data for the 1967-70 cohort were om^^-H , w P>">""tlons, 
depicted in Figure E-7 «.„ , """" 1" the unweighted averages 

P Figure E 7. Here. i„ every comparison, the postdoctorals rank 

H^r tp the general norm, and by a margin Urger than for the publ sLns 
data. It may be noted also, in Table E-5 ^h«^ ^k. 4 

*«oxe that the Increase in corrcct-^d 

case With corrected publications. The difference between the postdoctoral! 
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FIGURE E-7 

Corrected citation standard scores for bioscience PhD's and postdoctorals, 
1958>1966, by categories of employment in 1970 



Legend 

x " Postdoctorals 
o " PhD' 8 in General 




. *,17i 

o ... I 

ERIC 



154 



ERIC 



and the general norm also Incraaaes over tliBe» Indicating a euoiulatlve effect 
of the postdoctoral experience. It is quite possible that this cumulative 
effect is mediated by the fact that postdoctorals get themselves into posi- 
tions in which research is more important, and persist in research activities 
with more seal and continuity. It is, in effect, another example of "As the 
twig is bent, so the tree is incline". An initial bent for research leads 
to postdoctoral training, which in turn leads on to a more strongly research- 
oriented career, more publications, and publications which are more often 
cited by other scientists. The effect seems, from the data of this appendix, 
to be a quite general one, not dependent upon the postdoctoral training 
program of any single government agency. 



APPENDIX F 



Soma Topics for Further Research 



This report was addressed to the description and evaluation of the MIGMS 
postdoctoral program, and it was found that it was possible to obtain relatively 
unambiguous answers to the questions proposed at the initiation of the study. 
A n«d,er of important questions r«iain. however, for those concerned with the 
training of high-level manpower and the support of research in the biomedical 
fields. The Committee has addressed itself to the need for further develop- 
ments which might provide a more satisfactory systematic overview of scientific 
manpower supply and utilisation, of which postdoctoral training is an integral 
part. Some of the Committee's suggestions for further research follow: 

• What characteristics of institutions and of mentors are most highly re- 
lated to the subsequent productivity and careers of postdoctorals? For 
«»xample. is there an optimum sise and mix of students? 

e In what sub-fields of science is postdoctoral training most effective? 

• What are the values of senior postdoctoral training, as compared to that 
for immediate poat-PhD training? As the population of scientists ages, 
and as scientific knowledge and technology change more rapidly than do in- 
dividual scientists, it would appear that training of senior postdoctorals 
might be very important in preventing scientific obsolescence and decline 
m research efficiency, and would permit switching to newer fields with 
higher pay-off potential than those some scientists are pursuing at any 
given time. 

e As a larger and larger proportion of scientists may be expected in the 
future to be employed in nonacademic settings, what may we expect with 
regard to the value of postdoctoral training for these people in industry 
and government? 

. Most l,.p.rt«.t. fro. the o««ll standpclnt. I. the dev.lop«« of coeel 
model, of .dentlflc productivity «,d statu. att.lo«.nt. A s.tl.factory 
model would go far beyomi th. area of postdoctoral training alone, and 
would include both predoctor.1 education and later career develop«nt. and 
ln.tltutlon.1 raUtlonahlp. wall as Individual careers. The availability 
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of really good causal iBodels» and of the necessary Indicators of causes and 
consequences would make possible more adequate assessments of programs of 
all sorts - the postdoctoral programs, grants in support of research, support 
of predoctoral students, etc» 

Xn the absence of such a firm base for gauging the probable consequences 
of program changes, there is a tendency to regard any massive and/or precipi-- 
tous changes in the volume and sources of research and training support as 
potentially very dangerous. Those Involved in the training process feel that 
a social experiment with the scientific establishment may well produce results 
that would be disastrous, and whose long-term costs, as subsequent policy 
responds to correct the error, may well far overrun the cost of continuous 
support. They would cite, by way of analogy, the cost of tooling up again to 
make a supersonic transport, if that now defunct project, whose termination 
costs were very high, were to be revived. Similarly, they would argue, the 
pursuit of a scientific support program which causes research laboratories to 
close, training programs to shut down, and a field of inquiry to deteriorate, 
incurs, in The long run, costs to revitalise the area which outstrip the costs 
of continuous support. To meet this argument, a really adequate model of the 
scientific enterprise would allow a much more accurate estimate of the conse* 
quences of program modification or discontinuation than is possible at the 
present time. 

The extensive data asseinbled for the present study provide a rich and 
unique opportunity to construct a model of the scientific career which would 
parallel in significant ways the Blau^Duncan model of status attainment in the 
society at large. Quite apart from its intrinsic intellectual Interest, it 
would be a very important benchmark for evaluating the effects of various 
scientific manpower training programs. The construction of this model is re- 
garded as first-order business for those concerned with scientific manpower 
and the sociology of science. 



